I\'m using scrapy to crawl my sitemap, to check for 404, 302 and 200 pages. But i can\'t seem to be able to get the response code. This is my code so far:
fr
Only to have a complete response here:
Set Handle_httpstatus_list = [302];
Handle_httpstatus_list = [302];
On request, set dont_redirect to True on meta.
For example: Request(URL, meta={'dont_redirect': True});
Request(URL, meta={'dont_redirect': True});