问题
When trying to import data to S3 in Parquet format using Sqoop, as follows:
bin/sqoop import --connect 'jdbc:[conn_string]' --table [table] --target-dir s3a://bucket-name/ --hive-drop-import-delims --as-parquetfile
... I get the following error:
ERROR tool.ImportTool: Imported Failed: Wrong FS: s3a://bucket-name/, expected: hdfs://localhost:9000
I have no problem importing non-parquet data or working with s3a directly through HDFS. Seems like this issue, but it was supposedly fixed many versions ago.
回答1:
Sqoop import in parquet format currently doesn't support s3 as target directory, work around you can use is to import data to hdfs and then use distcp to copy the from hdfs to s3
回答2:
Sqoop doesn't support import to parquet file if you are using S3 as a target directory.
来源：https://stackoverflow.com/questions/33223110/sqoop-s3-parquet-results-in-wrong-fs-error