Selenium versus BeautifulSoup for web scraping

Question

I\'m scraping content from a website using Python. First I used BeautifulSoup and Mechanize on Python but I saw that the website had a button that

Answer 1

I would recommend using Selenium for things such as interacting with web pages whether it is in a full blown browser, or a browser in headless mode, such as headless Chrome. I would also like to say that beautiful soup is better for observing and writing statements that rely on if an element is found or WHAT is found, and then using selenium ot execute interactive tasks with the page if the user desires.