python基础爬虫案例+数据分析
最近在做一个课程设计,关于爬取安居客房价信息的,本次用到的框架有 BeautifulSoup xlwt,xlrd requests matplotlib pandas numpy 最终实现下图效果: ** 使用说明: 请先注册安居客账户 之后先运行spider.py 随后运行draw.py ** 爬虫代码 spider.py from bs4 import BeautifulSoup import requests import xlwt import time , random def getHouseList ( url ) : house = [ ] headers = { 'User-Agent' : 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.71 Safari/537.1 LBBROWSER' } # get从网页获取信息 res = requests . get ( url , headers = headers ) # 解析内容 soup = BeautifulSoup ( res . content , 'html.parser' ) # 房源title housename_divs = soup . find_all (