How to handle a generic internal error in Athena

微笑、不失礼 提交于 2019-12-25 01:12:01

问题


I have the following query used on one of my datasets in Athena.

CREATE TABLE clean_table
WITH (format='Parquet', external_location='s3://test123data') AS
SELECT npi,
         provider_last_name,
         provider_first_name,

    CASE
    WHEN REPLACE(num_entitlement_medicare_medicaid,',', '') ='' THEN
    null
    ELSE CAST(REPLACE(num_entitlement_medicare_medicaid,',', '') AS DECIMAL)
    END AS medicare_medicaid_entitlement,
    CASE
    WHEN REPLACE(total_submitted_charge_amount,',', '') ='' THEN
    null
    ELSE CAST(REPLACE(num_entitlement_medicare_medicaid,',', '') AS DECIMAL)
    END AS total_submitted_charge_amount
FROM cmsaggregatepayment2017

Unfortunately after I run this query I get an error as below:

GENERIC_INTERNAL_ERROR: Path is not absolute: s3://test123data. You may need to manually clean the data at location 's3://aws-athena-query-results-785609744360-us-east-1/Unsaved/2019/12/15/tables/03d3cedf-0101-43cb-91fd-cc8070db0e37' before retrying. Athena will not delete data in your account.

Can someone walk me through how to handle this? What do I have to do on the bucket since it is empty


回答1:


It appears that this message is referring to the Query result location in which Athena automatically stores the output of your queries.

This is useful for running queries on the results of queries, or for simply having a copy of the query output.

See: Working with Query Results, Output Files, and Query History - Amazon Athena

You can specify a new output location by clicking the settings link in the Athena console and then providing a Query result location path, such as: s3://my-bucket/athena-output/

I'm not sure what is causing your specific error, but make sure you append a trailing / to the location. You might also want to create a new bucket for that output.



来源:https://stackoverflow.com/questions/59348385/how-to-handle-a-generic-internal-error-in-athena

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!