基于scrapy框架的豆瓣爬虫

from scrapy.cmdline import execute
execute（[‘scrapy‘‘crawl‘‘douban‘]）

 属性            大小     日期    时间   名称
----------- ---------  ---------- -----  ----

     文件        478  2019-11-06 18:32  douban\.idea\douban.iml

     文件        303  2019-11-06 18:32  douban\.idea\misc.xml

     文件        271  2019-11-06 18:32  douban\.idea\modules.xml

     文件      12333  2019-11-13 20:47  douban\.idea\workspace.xml

     文件        191  2019-11-07 19:56  douban\.scrapy\httpcache\douban\0a\0a8d961c5cf075725ce493439e64ecef9797cea6\meta

     文件        157  2019-11-07 19:56  douban\.scrapy\httpcache\douban\0a\0a8d961c5cf075725ce493439e64ecef9797cea6\pickled_meta

     文件          0  2019-11-07 19:56  douban\.scrapy\httpcache\douban\0a\0a8d961c5cf075725ce493439e64ecef9797cea6\request_body

     文件        394  2019-11-07 19:56  douban\.scrapy\httpcache\douban\0a\0a8d961c5cf075725ce493439e64ecef9797cea6\request_headers

     文件      12318  2019-11-07 19:56  douban\.scrapy\httpcache\douban\0a\0a8d961c5cf075725ce493439e64ecef9797cea6\response_body

     文件        375  2019-11-07 19:56  douban\.scrapy\httpcache\douban\0a\0a8d961c5cf075725ce493439e64ecef9797cea6\response_headers

     文件        164  2019-11-07 17:45  douban\.scrapy\httpcache\douban\11\1102866a23b8314e83899a777a35ad7249d0abb3\meta

     文件        144  2019-11-07 17:45  douban\.scrapy\httpcache\douban\11\1102866a23b8314e83899a777a35ad7249d0abb3\pickled_meta

     文件          0  2019-11-07 17:45  douban\.scrapy\httpcache\douban\11\1102866a23b8314e83899a777a35ad7249d0abb3\request_body

     文件        171  2019-11-07 17:45  douban\.scrapy\httpcache\douban\11\1102866a23b8314e83899a777a35ad7249d0abb3\request_headers

     文件        106  2019-11-07 17:45  douban\.scrapy\httpcache\douban\11\1102866a23b8314e83899a777a35ad7249d0abb3\response_body

     文件        130  2019-11-07 17:45  douban\.scrapy\httpcache\douban\11\1102866a23b8314e83899a777a35ad7249d0abb3\response_headers

     文件        165  2019-11-07 17:48  douban\.scrapy\httpcache\douban\1e\1e4b634936f14c6a18e7d88f59a8ffc3c46370c5\meta

     文件        144  2019-11-07 17:48  douban\.scrapy\httpcache\douban\1e\1e4b634936f14c6a18e7d88f59a8ffc3c46370c5\pickled_meta

     文件          0  2019-11-07 17:48  douban\.scrapy\httpcache\douban\1e\1e4b634936f14c6a18e7d88f59a8ffc3c46370c5\request_body

     文件        325  2019-11-07 17:48  douban\.scrapy\httpcache\douban\1e\1e4b634936f14c6a18e7d88f59a8ffc3c46370c5\request_headers

     文件        275  2019-11-07 17:48  douban\.scrapy\httpcache\douban\1e\1e4b634936f14c6a18e7d88f59a8ffc3c46370c5\response_body

     文件        297  2019-11-07 17:48  douban\.scrapy\httpcache\douban\1e\1e4b634936f14c6a18e7d88f59a8ffc3c46370c5\response_headers

     文件        193  2019-11-07 19:56  douban\.scrapy\httpcache\douban\1e\1eaddf9a0730560642a4d1b2eb7e90ec26ea9c0e\meta

     文件        158  2019-11-07 19:56  douban\.scrapy\httpcache\douban\1e\1eaddf9a0730560642a4d1b2eb7e90ec26ea9c0e\pickled_meta

     文件          0  2019-11-07 19:56  douban\.scrapy\httpcache\douban\1e\1eaddf9a0730560642a4d1b2eb7e90ec26ea9c0e\request_body

     文件        394  2019-11-07 19:56  douban\.scrapy\httpcache\douban\1e\1eaddf9a0730560642a4d1b2eb7e90ec26ea9c0e\request_headers

     文件      12539  2019-11-07 19:56  douban\.scrapy\httpcache\douban\1e\1eaddf9a0730560642a4d1b2eb7e90ec26ea9c0e\response_body

     文件        375  2019-11-07 19:56  douban\.scrapy\httpcache\douban\1e\1eaddf9a0730560642a4d1b2eb7e90ec26ea9c0e\response_headers

     文件        194  2019-11-07 19:56  douban\.scrapy\httpcache\douban\36\368a5242083cc9dab290d77cbe6a81107c882290\meta

     文件        158  2019-11-07 19:56  douban\.scrapy\httpcache\douban\36\368a5242083cc9dab290d77cbe6a81107c882290\pickled_meta

............此处省略111个文件信息