Does urllib2.urlopen() cache stuff?

Question

They didn\'t mention this in python documentation. And recently I\'m testing a website simply refreshing the site using urllib2.urlopen() to extract certain content, I notic

Answer 1

Your web server or an HTTP proxy may be caching content. You can try to disable caching by adding a Pragma: no-cache request header:

request = urllib2.Request(url)
request.add_header('Pragma', 'no-cache')
content = urllib2.build_opener().open(request)