Ok so I need to download some web pages using Python and did a quick investigation of my options.
Included with Python:
urllib - seems to me that I should use ur
urllib2
is found in every Python install everywhere, so is a good base upon which to start.PycURL
is useful for people already used to using libcurl, exposes more of the low-level details of HTTP, plus it gains any fixes or improvements applied to libcurl.mechanize
is used to persistently drive a connection much like a browser would.It's not a matter of one being better than the other, it's a matter of choosing the appropriate tool for the job.