SinaSpider 动态IP解决新浪的反爬虫机制，快速抓取内容。.zip

SinaSpider, 动态IP解决新浪的反爬虫机制，快速抓取内容。

# -*- coding: utf-8 -*-
“““
Created on Sun Nov 13 01:31:22 2016

@author: weiya
“““


company = [‘世纪星源‘
‘沙河股份‘
‘招商地产‘
‘深圳能源‘
‘中粮地产‘
‘中集集团‘
‘中航地产‘
‘德赛电池‘
‘方大集团‘
‘深赛格‘
‘中金岭南‘
‘深圳华强‘
‘中兴通讯‘
‘北方国际‘
‘长城电脑‘
‘特发信息‘
‘海王生物‘
‘盐田港‘
‘广聚能源‘
‘中信海直‘
‘中成股份‘
‘丰原药业‘
‘常山股份‘
‘国际实业‘
‘东方市场‘
‘潍柴动力‘
‘许继电气‘
‘冀东水泥‘
‘金融街‘
‘华意压缩‘
‘胜利股份‘
‘沈阳机床‘
‘英特集团‘
‘合肥百货‘
‘通程控股‘
‘吉林化纤‘
‘南京中北‘
‘湖北宜化‘
‘东阿阿胶‘
‘徐工机械‘
‘华天酒店‘
‘晨鸣纸业‘
‘海虹控股‘
‘丽珠集团‘
‘渝开发‘
‘长航凤凰‘
‘美菱电器‘
‘广州浪奇‘
‘红太阳‘
‘柳工‘
‘广弘控股‘
‘大冷股份‘
‘力合股份‘
‘万家乐‘
‘万泽股份‘
‘广宇发展‘
‘云南白药‘
‘中天城投‘
‘皖能电力‘
‘中原环保‘
‘湖南投资‘
‘江铃汽车‘
‘创元科技‘
‘靖远煤电‘
‘泰山石油‘
‘万向钱潮‘
‘西安民生‘
‘海南海药‘
‘海德股份‘
‘泸州老窖‘
‘威孚高科‘
‘友利控股‘
‘桐君阁‘
‘大通燃气‘
‘古井贡酒‘
‘东北制药‘
‘青岛双星‘
‘建投能源‘
‘韶能股份‘
‘青海明胶‘
‘阳光股份‘
‘绵世股份‘
‘湖北金环‘
‘石油济柴‘
‘海螺型材‘
‘吉林敖东‘
‘长安汽车‘
‘如意集团‘
‘天茂集团‘
‘高新发展‘
‘铜陵有色‘
‘顺发恒业‘
‘三木集团‘
‘英力特‘
‘风华高科‘
‘茂化实华‘
‘仁和药业‘
‘格力电器‘
‘泰达股份‘
‘金岭矿业‘
‘长春高新‘
‘索芙特‘
‘永安林业‘
‘经纬纺机‘
‘荣丰控股‘
‘阳光城‘
‘襄阳轴承‘
‘大连友谊‘
‘山推股份‘
‘东方电子‘
‘远兴能源‘
‘中山公用‘
‘宝新能源‘
‘滨海能源‘
‘沈阳化工‘
‘模塑科技‘
‘厦门信达‘
‘正虹科技‘
‘浙江震元‘
‘双环科技‘
‘大冶特钢‘
‘天兴仪表‘
‘丰乐种业‘
‘中兴商业‘
‘韶钢松山‘
‘苏宁环球‘
‘西安饮食‘
‘美锦能源‘
‘华东科技‘
‘燕京啤酒‘
‘四川美丰‘
‘振华科技‘
‘罗牛山‘
‘长城信息‘
‘锌业股份‘
‘西藏发展‘
‘漳州发展‘
‘山西三维‘
‘新华制药‘
‘中色股份‘
‘本钢板材‘
‘西藏矿业‘
‘通化金马‘
‘漳泽电力‘
‘中核科技‘
‘新兴铸管‘
‘三毛派神‘
‘平庄能源‘
‘美达股份‘
‘武汉中商‘
‘北新建材‘
‘华神集团‘
‘华闻传媒‘
‘太原刚玉‘
‘中国武夷‘
‘中水渔业‘
‘一汽轿车‘
‘金宇车城‘
‘云铝股份‘
‘烟台冰轮‘
‘陕西金叶‘
‘天山纺织‘
‘岳阳兴长‘
‘京山轻机‘
‘山东海化‘
‘超声电子‘
‘太钢不锈‘
‘东莞控股‘
‘鲁西化工‘
‘贵糖股份‘
‘鑫茂科技‘
‘中信国安‘
‘承德露露‘
‘华茂股份‘
‘高鸿股份‘
‘五粮液‘
‘国风塑业‘
‘顺鑫农业‘
‘海印股份‘
‘银星能源‘
‘安凯客车‘
‘吉电股份‘
‘新希望‘
‘天山股份‘
‘云南铜业‘
‘潍柴重机‘
‘大连国际‘
‘华联股份‘
‘同力水泥‘
‘海南高速‘
‘中鼎股份‘
‘法尔胜‘
‘东凌粮油‘
‘双汇发展‘
‘津滨发展‘
‘鞍钢股份‘
‘赣能股份‘
‘现代投资‘
‘航天科技‘
‘云内动力‘
‘厦门港务‘
‘数源科技‘
‘大亚科技‘
‘南宁糖业‘
‘钱江摩托‘
‘山大华特‘
‘华北高速‘
‘电广传媒‘
‘嘉凯城‘
‘金陵药业‘
‘南方汇通‘
‘河北宣工‘
‘福星股份‘
‘兰州黄河‘
‘华菱钢铁‘
‘神火股份‘
‘冀中能源‘
‘紫光股份‘
‘南天信息‘
‘新乡化纤‘
‘建峰化工‘
‘中国重汽‘
‘广济药业‘
‘中通客车‘
‘首钢股份‘
‘锡业股份‘
‘中南建设‘
‘东方钽业‘
‘华东医药‘
‘天保基建‘
‘长源电力‘
‘上风高科‘
‘煤气化‘
‘安泰科技‘
‘中科三环‘
‘新中基‘
‘浪潮信息‘
‘金马股份‘
‘中银绒业‘
‘西山煤电‘
‘大庆华科‘
‘广州友谊‘
‘华工科技‘
‘九芝堂‘
‘诚志股份‘
‘闽东电力‘
‘中国中期‘
‘新大陆‘
‘隆平高科‘
‘华润三九‘
‘宗申动力‘
‘新和成‘
‘伟星股份‘
‘德豪润达‘
‘精功科技‘
‘华兰生物‘
‘大族激光‘
‘天奇股份‘
‘传化股份‘
‘盾安环境‘
‘凯恩股份‘
‘永新股份‘
‘世荣兆业‘
‘东信和平‘
‘京新药业‘
‘海特高新‘
‘航天电器‘
‘山东威达‘
‘七喜控股‘
‘思源电气‘
‘七匹狼‘
‘达安基因‘
‘苏泊尔‘
‘美欣达‘
‘华帝股份‘
‘久联发展‘
‘双鹭药业‘
‘黔源电力‘
‘南京港‘
‘登海种业‘
‘华孚色纺‘
‘兔宝宝‘
‘轴研科技‘
‘宁波华翔‘
‘三花股份‘
‘中工国际‘
‘同洲电子‘
‘云南盐化‘
‘德美化工‘
‘得润电子‘
‘横店东磁‘
‘中钢天源‘
‘威尔泰‘
‘粤水电‘
‘江山化工‘
‘宏润建设‘
‘远光软件‘
‘华峰氨纶‘
‘东华软件‘
‘瑞泰科技‘
‘景兴纸业‘
‘黑猫股份‘
‘獐子岛‘
‘众和股份‘
‘软控股份‘
‘雪莱特‘
‘大港股份‘
‘太阳纸业‘
‘苏州固锝‘
‘中材科技‘
‘金螳螂‘
‘栋梁新材‘
‘孚日股份‘
‘海鸥卫浴‘
‘万丰奥威‘
‘东方海洋‘
‘新野纺织‘
‘新海宜‘
‘金智科技‘
‘江苏国泰‘
‘中泰化学‘
‘国脉科技‘
‘青岛金王‘
‘生意宝‘
‘南岭民爆‘
‘山河智

 属性            大小     日期    时间   名称
----------- ---------  ---------- -----  ----
     目录           0  2017-09-10 00:05  SinaSpider-master\
     文件        1057  2017-09-10 00:05  SinaSpider-master\LICENSE
     文件        2727  2017-09-10 00:05  SinaSpider-master\README.md
     文件     2618258  2017-09-10 00:05  SinaSpider-master\blog.tar.gz
     目录           0  2017-09-10 00:05  SinaSpider-master\blog\
     文件       64315  2017-09-10 00:05  SinaSpider-master\blog\WeiboItemAll.png
     文件       12365  2017-09-10 00:05  SinaSpider-master\blog\blog.md
     文件         754  2017-09-10 00:05  SinaSpider-master\blog\blog.md~
     文件      326657  2017-09-10 00:05  SinaSpider-master\blog\db.png
     文件      522355  2017-09-10 00:05  SinaSpider-master\blog\f12.png
     文件      136268  2017-09-10 00:05  SinaSpider-master\blog\pages35.png
     文件      135973  2017-09-10 00:05  SinaSpider-master\blog\pages38.png
     文件       57168  2017-09-10 00:05  SinaSpider-master\blog\results.png
     文件      517344  2017-09-10 00:05  SinaSpider-master\blog\search1.png
     文件      199954  2017-09-10 00:05  SinaSpider-master\blog\search2.png
     文件        1261  2017-09-10 00:05  SinaSpider-master\blog\simpleyzm.jpg
     文件      628151  2017-09-10 00:05  SinaSpider-master\blog\sources.png
     文件       52875  2017-09-10 00:05  SinaSpider-master\blog\yzm.png
     文件       19420  2017-09-10 00:05  SinaSpider-master\code.csv
     文件      731136  2017-09-10 00:05  SinaSpider-master\company0000.db
     文件       19472  2017-09-10 00:05  SinaSpider-master\companyList.py
     文件      326657  2017-09-10 00:05  SinaSpider-master\db.png
     文件         377  2017-09-10 00:05  SinaSpider-master\readcode.py
     文件        4349  2017-09-10 00:05  SinaSpider-master\result.py
     文件       57168  2017-09-10 00:05  SinaSpider-master\results.png
     文件         339  2017-09-10 00:05  SinaSpider-master\run.py
     文件         205  2017-09-10 00:05  SinaSpider-master\runResult.py
     文件       14017  2017-09-10 00:05  SinaSpider-master\sinaCrawlforADSL.py
     文件        7546  2017-09-10 00:05  SinaSpider-master\user_agents.py