Is it possible to use .NET framework with the Python scrapy framework to scrape data from different sites? I am working on my final year project in which I want to use C# as front end language and Python for scraping the data.
Hemache
I don't think it is possible, because Scrapy uses twisted networking engine which can not run on IronPython
Alternatively, you may start your spider/crawler through command line using C# and then interact with it using JSON API
Take a look at ScrapySharp, also described on this blog, which is the C# version of python's Scrapy.
来源：https://stackoverflow.com/questions/23511569/net-framework-with-scrapy-python