I don\'t have a specific code issue I\'m just not sure how to approach the following problem logistically with the Scrapy framework:
The structure of the data I want
Please, first read the docs to understand what i say.
The answer:
To scrape additional fields which are on other pages, in a parse method extract URL of the page with additional info, create and return from that parse method a Request object with that URL and pass already extracted data via its meta
parameter.
how do i merge results from target page to current page in scrapy?