Issue found.
In startup.cs instead of adding "services.AddTransient();"
Add ".AddProfileService()" to services.AddIdentityServer()
You will end up with
services.AddIdentityServer()
.AddTemporarySigningCredential()
.AddInMemoryIdentityResources(Config.GetIdentityResources())
.AddInMemoryApiResources(Config.GetApiResources())
.AddInMemoryClients(Config.GetClients())
.AddAspNetIdentity()
.AddProfileService();
Thanks for Coemgen for helping out! nothing wrong with the code, just the startup was wrong.