ubuntu12.04下scrapy配置

• Python 2.7
• lxml. Most Linux distributions ships prepackaged versions of lxml. Otherwise refer tohttp://lxml.de/installation.html
• OpenSSL. This comes preinstalled in all operating systems except Windows (see Platform specific installation notes)
• pip or easy_install Python package managers

 http://doc.scrapy.org/en/latest/intro/install.html

 

error: Python.h: No such file or directory

安装python：sudo apt-get install python-dev

Try if this works sudo apt-get install python-dev and some time sudo apt-get update also it will install any missing header It helped me alot....

 

ImportError: No module named w3lib.http

pip install w3lib

 

ImportError: No module named twisted

pip install twisted

 

ImportError: No module named lxml.html

pip install lxml
error: libxml/xmlversion.h: No such file or directory
解决：apt-get install libxml2-dev libxslt-dev
apt-get install python-lxml

ImportError: No module named cssselect

解决：pip install cssselect

 

ImportError: No module named OpenSSL

pip install pyOpenSSL

附Python安装命令：

python setup.py install