python,not getting full response

Question

when I want to get the page using urllib2, I don\'t get the full page.

here is the code in python:

import urllib2
import urllib
import socket
from bs         


        

Answer 1

I had the same problem, I though it was urllib but it was bs4.

Instead of use

BeautifulSoup(src)

or

soup = bs4.BeautifulSoup(html, 'html.parser')

try use

soup = bs4.BeautifulSoup(html, 'html5lib')