How do I remove all these extra simulators from my Xcode menu?
There is a nice shell script that deletes all simulators and creates a list of new ones for you on GitHub without the need of Fastlane (even though Fastlane is worth to have anyway):
https://github.com/jerolimov/reset_simulators