This is driving the whole team crazy. There must be some simple mis-configured part of IIS or our Web Server, but every time we try to run out ASP.NET Web Application on IIS
The below config was the cause of my issue:
Note: I removed this section for local testing, as it works fine in Azure.