For future readers: I ran into this issue because I had ran a prod build of my app before trying to debug. The prod build removes the sourcemaps that VS Code needs to debug successfully, so I ran a dev build of my app and then debug, and everything worked as expected.