I have created a new project of React Native with a typescript template using the official command react-native init MyApp --template typescript (a couple of times
Seems like you didn't execute the post installation setup script which takes care of removing the App.js file. Anyway, that's not necessary anymore as with the release of React Native 0.59 the post installation setup script is being executed automatically.