How to scrape dynamic webpages by Python

前端 未结 2 1136
粉色の甜心
粉色の甜心 2020-12-06 13:42

[What I\'m trying to do]

Scrape the webpage below for used car data.
http://www.goo-net.com/php/search/summary.php?price_range=&pref_c=08,

相关标签:
2条回答
  • 2020-12-06 14:04

    The python module splinter may be a good starting point. It calls an external browser (such as Firefox) and access the browser's DOM rather than dealing with HTML only.

    0 讨论(0)
  • 2020-12-06 14:24

    you can use selenium like below sample:

    from selenium import webdriver
    driver = webdriver.Firefox()
    driver.get('http://example.com')
    element = driver.find_element_by_class_name("yourClassName") #or find by text or etc
    element.click() 
    
    0 讨论(0)
提交回复
热议问题