AWS lambda with python asyncio. Event loop closed problem?

这一生的挚爱 提交于 2020-07-09 12:52:45

问题


Closing the event loop in aws lambda affects future lambda runs??

  • I have some aysncio python code running within an aws lambda service. The logic of the code is as follows

    def lambda_handler(event,context):
        loop = asyncio.get_event_loop()
        # perform all operations with the loop
        loop.close()
        return results
    
  • If I run this once, it appears to work fine. However, if I rerun it immediately afterwards, I get an error saying Event loop closed

  • Why is this happening? Shouldn't each lambda run be independent of the last? After all lambda is supposed to be stateless

回答1:


After all lambda is supposed to be stateless

Your function is supposed to be stateless.

From https://aws.amazon.com/lambda/faqs/:

Q: What is an AWS Lambda function?

...

The code must be written in a “stateless” style i.e. it should assume there is no affinity to the underlying compute infrastructure.

...

Q: Will AWS Lambda reuse function instances?

To improve performance, AWS Lambda may choose to retain an instance of your function and reuse it to serve a subsequent request, rather than creating a new copy. To learn more about how Lambda reuses function instances, visit our documentation. Your code should not assume that this will always happen.

The current python instance is reused for performance reasons, but its reuse or non-reuse must never be relied on. So while AWS Lambda is not itself always stateless, your programming methodology should be. Hopefully that clears up your confusion as to why that is happening!




回答2:


Python 3.7+

You can use the higher level asyncio.run() that will take care of things.

def handler(event, context):
    asyncio.run(main())

async def main():
    # your async code here

This will close the loop at the end and open a new one one running lambda again. .run() is also recommended by asyncio maintainers.




回答3:


Add this line of the top of the code,

asyncio.set_event_loop(asyncio.new_event_loop())

so that it is global.

Alternatively,

Replace,

loop = asyncio.get_event_loop()

with,

loop = asyncio.new_event_loop()

It is happening since you already closed the loop.

That should work.



来源:https://stackoverflow.com/questions/59293415/aws-lambda-with-python-asyncio-event-loop-closed-problem

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!