How to use CSS selectors to retrieve specific links lying in some class using BeautifulSoup?

Question

I am new to Python and I am learning it for scraping purposes I am using BeautifulSoup to collect links (i.e href of \'a\' tag). I am trying to collect the links under the \

Answer 1

The page is not the most friendly in the use of classes and markup, but even so your CSS selector is too specific to be useful here.

If you want Upcoming Events, you want just the first

, then just grab the

tags, so the links on titles:

upcoming_events_div = soup.select_one('div#events-horizontal')
for link in upcoming_events_div.select('div.title a[href]'):
    print link['href']

Note that you should not use r.text; use r.content and leave decoding to Unicode to BeautifulSoup. See Encoding issue of a character in utf-8

0 讨论(0)

查看其它3个回答

发布评论:

提交评论

---

•  加载中...