How can I input data into a webpage to scrape the resulting output using Python?

前端 未结 5 1497
予麋鹿
予麋鹿 2020-12-15 12:43

I am familiar with BeautifulSoup and urllib2 to scrape data from a webpage. However, what if a parameter needs to be entered into the page before the result that I want to

5条回答
  •  自闭症患者
    2020-12-15 13:05

    The query may have been resolved.

    You can use Selenium WebDriver for this purpose. A web page can be interacted using programming language. All the operations can be performed as if a human user is accessing the web page.

提交回复
热议问题