I\'m a little new to Python and very new to Scrapy.
I\'ve set up a spider to crawl and extract all the information I need. However, I need to pass a .txt file of U
If your urls are line seperated
def get_urls(filename): f = open(filename).read().split() urls = [] for i in f: urls.append(i) return urls
then this lines of code will give you the urls.