Uvicorn + Gunicorn + Starlette is getting stuck when serving, can't restart the service without sigkill

Question

I am serving a model on a VM through gunicorn + uvicorn.

It is automatically started by supervisord, running api.sh.

api.sh contains: