I know Ctrl+Shift+Backspace is used to go to the location of the last edit.
But I want to jump to whichever location I was most rece
Many excellent answers so far, and they do answer the question...But, if you don't want to have to deal with disabling graphics driver's settings, or creating new keyboard mappings, or are developing through a remote session (RDP) or within a VM that intercepts your keystrokes, good-old keyboard navigation still works. Just do Alt-N to bring up the Navigate menu and then hit the B key.
Please note that you don't hit all keys at the same time. So:
Alt-N wait B
This is what I use all the time, for exactly the case that the OP asked about. Also, this will probably hold through any IntelliJ updates.