Scraping sites that require login with Python

Question

I use several ad networks for my sites, and to see how much money I made I need to log in to each daily to add up the values. I was thinking of making a Python script that would

Answer 1

cookielib does client-side cookie handling, and mechanize enhances it in several ways -- including a way to initialize a cookie jar by reading the cookies from an Internet Explorer cache (so, if you can log in manually once to each site on Windows, you can then use cookielib or mechanize for future logins based on exactly the same cookies -- until they expire of course).

Answer 2

See if this work for you:

http://stockrt.github.com/p/emulating-a-browser-in-python-with-mechanize/

Answer 3

not a Python solution, but consider using a browser automation tool like Chickenfoot.