利用post请求发送内容进行爬虫

 1 import requests
 2 
 3 url = 'http://www.iqianyue.com/mypost'
 4 header = {}
 5 header['Accept-Language'] = 'zh-CN,zh;q=0.9'
 6 header['Cache-Control'] = 'max-age=0'
 7 header['Connection'] = 'keep-alive'
 8 header['Content-Length'] = '11'
 9 header['Content-Type'] = 'application/x-www-form-urlencoded'
10 header['User-Agent'] = 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_3) AppleWebKit/537.36 (KHTML, like Gecko)' 
11                        ' Chrome/65.0.3325.181 Safari/537.36'
12 data = {"name":"213161836",
13         "pass":"15713927150yzxc"}
14 
15 rq = requests.post(url,data=data,headers=header)
16 print(rq.text)

响应结果：

<html>
<head>
<title>Post Test Page</title>
</head>

<body>
<form action="" method="post">
name:<input name="name" type="text" /><br>
passwd:<input name="pass" type="text" /><br>
<input name="" type="submit" value="submit" />
<br />
you input name is:213161836<br>you input passwd is:15713927150yzxc</body>
</html>

可以看到发送的name和passwd发送成功，在返回的结果中可以查找到

参考文章：https://blog.csdn.net/weixin_40188147/article/details/78173695