问题
I using scrapy, and I would like to get Ignoring response URL.I just see in the output console this:
DEBUG: Ignoring response <999 https://www.mywebsite.com>: HTTP status code is not handled or not allowed.
回答1:
According to the documentation here you can add a list of HTTP status codes which should be handled by your spider even if they are not allowed by default.
In your case you have to add following line to your spider definition:
handle_httpstatus_list = [999]
This will cause the spider to get the result even with this status code.
Next time before asking a question pleas look through StackOverflow for similar questions and read the docs. And it won't be wrong to put some code to let us know where is your error happening. Without this information it is seldom that the community can give any answers.
来源：https://stackoverflow.com/questions/32779766/auth-failing-999-http-status-code-is-not-handled-or-not-allowed