Scrapy with Selenium does not detect HTML element loaded dynamically
问题 I am using Scrapy with Selenium to scrape content from this page: https://nikmikk.itch.io/door-knocker In it, there is a table under the div with class .game_info_panel_widget , where the first row Published 62 days ago seems to be loaded dynamically. I have try fetching the page as Scrapy sees but cannot find that row in the html. scrapy fetch --nolog https://nikmikk.itch.io/door-knocker > test.html Here is what I see in test.html , the first table row is the Status, not the Published row