Read a csv file from aws s3 using boto and pandas

前端 未结 3 532
一整个雨季
一整个雨季 2021-02-04 07:14

I have already read through the answers available here and here and these do not help.

I am trying to read a csv object from S3 bucket and have

3条回答
  •  刺人心
    刺人心 (楼主)
    2021-02-04 08:15

    This worked for me.

    import pandas as pd
    import boto3
    import io
    
    s3_file_key = 'data/test.csv'
    bucket = 'data-bucket'
    
    s3 = boto3.client('s3')
    obj = s3.get_object(Bucket=bucket, Key=s3_file_key)
    
    initial_df = pd.read_csv(io.BytesIO(obj['Body'].read()))
    

提交回复
热议问题