Scraping Data that is Initially Hidden and appears after Submit
问题 I need to scrape the website - https://mphc.gov.in/judgement-orders Under the section Free-Text-text, I need to Enter 'A' in the Free-Text Field. Then select the date range - Say - 19-06-2020 to 19-06-2020 , then click the Search Button. I tried doing this using the below code : def start_requests(self): yield scrapy.Request(self.start_urls[0], callback=self.parse,errback=self.errback_httpbin,dont_filter=True) def parse(self, response): headers={ 'Accept': '*/*', 'Accept-Encoding': 'gzip,