.net framework with scrapy python [closed]

问题

Closed. This question needs to be more focused. It is not currently accepting answers.

---

Want to improve this question? Update the question so it focuses on one problem only by editing this post.

Closed last year.

Is it possible to use .NET framework with the Python scrapy framework to scrape data from different sites? I am working on my final year project in which I want to use C# as front end language and Python for scraping the data.

回答1:

I don't think it is possible, because Scrapy uses twisted networking engine which can not run on IronPython

Alternatively, you may start your spider/crawler through command line using C# and then interact with it using JSON API

回答2:

Take a look at ScrapySharp, also described on this blog, which is the C# version of python's Scrapy.

来源：https://stackoverflow.com/questions/23511569/net-framework-with-scrapy-python