API Management ARM template deployment fails with IdentifierAlreadyInUse error

Question

Deploying API Management ARM template (generated via the extractor tool), I get an error with code IdentifierAlreadyInUse and the message Resource already