中国应急服务网自然灾害python爬虫
代码如下 import requests from bs4 import BeautifulSoup headers = { 'User-Agent' : 'Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko' } url = "http://www.52safety.com/yjzrzh/index.jhtml" html = requests . get ( url ) soup = BeautifulSoup ( html . text , 'lxml' ) data = soup . select ( 'body > div > div.main.container_1000 > div.main_left > div.index_list.list_news.index_list_bg > ul > li' ) for item in data : result = { 'title' : item . get_text ( ) , } print ( result ) 结果显示 { 'title' : '北京房山区发生3.2级地震 震源深度13千米［2020-01-10］' } { 'title' : '四川宜宾市兴文县发生4.1级地震 震源深度12千米［2020-01-08］' }