How to speed up Amazon Athena query executions?

喜夏-厌秋 提交于 2019-12-11 15:51:50

问题


I'm using Athena Query Execution to retrieve data from a Glue Table. A Crawler updates this table every hour using a S3 Bucket which is continuously updated by Kinesis Firehose.

My Node.js server executes basic queries using Athena. But I realized that some of the requests takes so long that my server throws Server Request Timeout.

I checked the Query History in Athena and I saw some of the latest requests' state is Queued which means they are waiting to be executed. They all have a small Run Time in the range of 1 to 5 seconds. It's obvious that the problem is not the Run Time causes timeouts but it's the queue.

How can I speed up the execution of these queries? or how can I increase concurrent execution limits so Athena immediately executes them?

来源:https://stackoverflow.com/questions/59072615/how-to-speed-up-amazon-athena-query-executions

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!