Python Requests: requests.exceptions.TooManyRedirects: Exceeded 30 redirects

Question

I was trying to crawl this page using python-requests library

import requests
from lxml import etree,html

url = \'http://www.amazon.in/b/ref=sa_menu_mobile_         


        

Answer 1

Increase of max_redirect is possible by explicitly specifying the count as in example below:

session = requests.Session()
session.max_redirects = 60
session.get('http://www.amazon.com')