伯乐在线文章URL

  • 一段代码,可以跑出所有文章的url
  • # encoding: utf-8             
    import requests               
    from bs4 import BeautifulSoup 
                                  
    base_url = 'http://blog.jobbol
                                  
    session = requests.session()  
    i=0                           
    for i in range(559):          
        url = base_url+str(i)+"/" 
        # print(url)              
        res = session.get(url=url)
        soup = BeautifulSoup(res.t
        post_nodes = soup.select("
        for post_node in post_node
            post_url = post_node.g
            i+=1                  
            print(i,post_url)     
原文地址:https://www.cnblogs.com/longbigbeard/p/9195405.html