Scrapy: Follow link to get additional Item data?

前端 未结 3 776
无人共我
无人共我 2020-11-29 00:32

I don\'t have a specific code issue I\'m just not sure how to approach the following problem logistically with the Scrapy framework:

The structure of the data I want

3条回答
  •  时光取名叫无心
    2020-11-29 00:52

    Please, first read the docs to understand what i say.

    The answer:

    To scrape additional fields which are on other pages, in a parse method extract URL of the page with additional info, create and return from that parse method a Request object with that URL and pass already extracted data via its meta parameter.

    how do i merge results from target page to current page in scrapy?

提交回复
热议问题