02-scrapy安装及目录结构

1. mkvirtualenv --python==C:UserszhengshengAppDataLocalProgramsPythonPython36-32python.exe article_spider

2.pip install -i https://pypi.douban.com/simple scrapy

  安装scrapy会安装twisted, 如果报错,就到https://www.lfd.uci.edu/~gohlke/pythonlibs/#wordcloud中搜索twisted, 下载py36 win32的whl文件,并pip install .whl

3.cd projectdir  workon article_spider

4.scrapy startproject ArticleSpider

5.cd ArticleSpider

6.scrapy genspider jobbole blog.jobbole.com

7. pip install pypiwin32

原文地址:https://www.cnblogs.com/jiamengyang/p/8192433.html