how to scrape a page request using Viewstate parameter?
问题 I've been trying to scrape this website : http://www.e3050.com/Cases-Fans-PDU/C I can scrape anything normally but moving to the next page, after debugging I found that they send the __Viewstate parameter for each page request. The viewstate parameter is stored in each page response, so I figured out that I need to get it per page and send it to the following page. I get the __viewstate using this xpath : sel.xpath('//input[@id="__VIEWSTATE"]/@value').extract() I also got an error, because