Import multiple csv files into pandas and concatenate into one DataFrame

前端 未结 16 2011
既然无缘
既然无缘 2020-11-21 07:47

I would like to read several csv files from a directory into pandas and concatenate them into one big DataFrame. I have not been able to figure it out though. Here is what I

16条回答
  •  轮回少年
    2020-11-21 08:06

    If the multiple csv files are zipped, you may use zipfile to read all and concatenate as below:

    import zipfile
    import numpy as np
    import pandas as pd
    
    ziptrain = zipfile.ZipFile('yourpath/yourfile.zip')
    
    train=[]
    
    for f in range(0,len(ziptrain.namelist())):
        if (f == 0):
            train = pd.read_csv(ziptrain.open(ziptrain.namelist()[f]))
        else:
            my_df = pd.read_csv(ziptrain.open(ziptrain.namelist()[f]))
            train = (pd.DataFrame(np.concatenate((train,my_df),axis=0), 
                              columns=list(my_df.columns.values)))
    

提交回复
热议问题