Write to a csv file scrapy

Question

I want to write to csv file in scrapy

 for rss in rsslinks:
  item = AppleItem()
  item[\'reference_link\'] = response.url
  base_url = get_base_url(response         


        

Answer 1

Best approach to solve this problem is to use python in-build csv package.

import csv

file_name = open('Output_file.csv', 'w') #Output_file.csv is name of output file

fieldnames = ['reference_link', 'rss_link'] #adding header to file
writer = csv.DictWriter(file_name, fieldnames=fieldnames)
writer.writeheader()
for rss in rsslinks:
    base_url = get_base_url(response)
    writer.writerow({'reference_link': response.url, 'rss_link': urljoin_rfc(base_url, rss)}) #writing data into file.