Web Scraping using Python Scrapy_BS4

Install the following software before web scraping.

  • Visual Studio Code
  • Python and Pip 
pip install virtualenv

virtualenv myenv

 Activating a Virtual Environment

Myenvscriptsactivate     -Windwos
Source myenv/scripts/avtivate    -Mac

 

  •  BeautifulSoup

Documents: https://www.crummy.com/software/BeautifulSoup/bs4/doc/

pip install bs4

 Check the installation status of beautiful soup.

  •  Scapy

Documents:https://scapy.readthedocs.io/en/latest/

pip install scrapy

相信未来 - 该面对的绝不逃避,该执著的永不怨悔,该舍弃的不再留念,该珍惜的好好把握。
原文地址:https://www.cnblogs.com/keepmoving1113/p/11787291.html