Iframe not loading resources with the correct base-href

Question

I have a create-react-app deployed to aws cloudfront with an API gateway in front of it (need it to use the API Keys with