I have a csv file with the dimensions 100*512 , I want to process it further in spark. The problem with the file is that it doesn\'t contain header i.e
100*512
spark
First read your csv file:
from pandas import read_csv df = read_csv('test.csv')
If there are two columns in your dataset(column a, and column b) use:
df.columns = ['a', 'b']
Write this new dataframe to csv
df.to_csv('test_2.csv')