I finally figured out that Visual Studio keeps track of how you create a project (in other words which project template you select initially) and filters your options later
I needed to add WPF support to a project of type "Class Library (.NET CORE)" in this way:
true
Now you can add a WPF Window