Read a csv file from aws s3 using boto and pandas

前端 未结 3 538
一整个雨季
一整个雨季 2021-02-04 07:14

I have already read through the answers available here and here and these do not help.

I am trying to read a csv object from S3 bucket and have

3条回答
  •  萌比男神i
    2021-02-04 07:57

    Here is what I have done to successfully read the df from a csv on S3.

    import pandas as pd
    import boto3
    
    bucket = "yourbucket"
    file_name = "your_file.csv"
    
    s3 = boto3.client('s3') 
    # 's3' is a key word. create connection to S3 using default config and all buckets within S3
    
    obj = s3.get_object(Bucket= bucket, Key= file_name) 
    # get object and file (key) from bucket
    
    initial_df = pd.read_csv(obj['Body']) # 'Body' is a key word
    

提交回复
热议问题