This is similar to IdentityServer4 Force User to re-enter credentials, but the solution there says to use prompt=login query string in the /authorize U
You should be able to achieve desired behaviour by overriding the default cookie scheme that AddIdentityServer() registers internally:
services.AddIdentityServer()...
services.AddAuthentication("CustomScheme")
.AddCookie("CustomScheme", options =>
{
options.ExpireTimeSpan = ...;
});
Make sure you add the override scheme after AddIdentityServer(), the sequence here is important due to the way ASP.Net Core DI works.