urllib

OS: Windows 7; Python 2.7.3 using the Python GUI Shell I'm trying to read a website through Python, and several authors use the urllib and urllib2 libraries. To store the site in a variable, I've seen a similar approach proposed: import urllib import urllib2 g = "http://www.google.com/" read = urllib2.urlopen(g) The last line generates an error after a 120+ seconds: > Traceback (most recent call last): File "<pyshell#27>", line 1, in > <module> > r = urllib2.urlopen(o) File "C:\Python27\lib\urllib2.py", line 126, in urlopen > return _opener.open(url, data, timeout) File "C:\Python27\lib

I'm new to Python and reading someone else's code: should urllib.urlopen() be followed by urllib.close() ? Otherwise, one would leak connections, correct? The close method must be called on the result of urllib.urlopen , not on the urllib module itself as you're thinking about (as you mention urllib.close -- which doesn't exist). The best approach: instead of x = urllib.urlopen(u) etc, use: import contextlib with contextlib.closing(urllib.urlopen(u)) as x: ...use x at will here... The with statement, and the closing context manager, will ensure proper closure even in presence of exceptions.

If I do url = "http://example.com?p=" + urllib.quote(query) It doesn't encode / to %2F (breaks OAuth normalization) It doesn't handle Unicode (it throws an exception) Is there a better library? Nadia Alramli From the docs : urllib.quote(string[, safe]) Replace special characters in string using the %xx escape. Letters, digits, and the characters '_.-' are never quoted. By default, this function is intended for quoting the path section of the URL.The optional safe parameter specifies additional characters that should not be quoted — its default value is '/' That means passing '' for safe will

Python爬虫爬取网页数据并存储（一） 环境搭建 爬虫基本原理 urllib库使用 requests库使用 正则表达式 一个示例 环境搭建 1.需要事先安装anaconda（或Python3.7）和pycharm *anaconda可在中科大镜像下下载较快 2.安装中遇到的问题： *anaconda（记得安装过程中点添加路径到path里，没添加的话手动添加： 计算机右键属性——高级系统设置——环境变量——用户/系统变量path路径中，添加 C:\Users\Aurora\Anaconda3;（anaconda安装路径）） 打开jupyter notebook ，出现页面空白解决方案： 打开 C:\Users\自己的用户名.jupyter\jupyter_notebook_config.py 在末尾输入以下代码： import webbrowser webbrowser.register(“Chrome”, None, webbrowser.GenericBrowser(u"C:\Program Files (x86)\Google\Chrome\Application\chrome.exe")) c.NotebookApp.browser = u’Chrome’ ##浏览器名，浏览器路径（通过右键属性可以看到路径） *anaconda ，打开cmd/anaconda prompt