Any idea on how to scrape pages which are behind __doPostBack('…');?

一世执手 提交于 2019-12-06 11:15:33

问题


I am working on this php base scraper/crawler, which works fine until it get .net generated herf link __doPostBack(...), any idea how to deal with this and crawl page behind those links ?


回答1:


Instead of trying to automate clicking the JavaScript button, which requires additional libraries in PHP, try replicating what request is sent by your browser after clicking the button. There are various firefox extensions that will help you examine the request, such as TamperData, Firebug, and LiveHttp.



来源:https://stackoverflow.com/questions/5658801/any-idea-on-how-to-scrape-pages-which-are-behind-dopostback

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!