App Service -> Azure SQL DB using a managed identity. Strange exception

Question

I am trying to set up a connection from my App Service to Azure SQL DB with managed identity. I am using this tutorial https://docs.microsoft.com/en-us/azure/app-service/app