Even though its obnoxious in a lot of ways I use PHPMyAdmin all the time to debug database issues while writing PHP. By default it sorts tables by primary key ascending. 99%
@jeremyclarke, in phpMyAdmin v3.4.5, after login click "home" then, from "More" menu choose "Settings" click "Main frame" tab, then "Browse mode" tab
There you'll find "Default sorting order" the default mode is set to SMART hence, choose "ASC" or "DESC"
If you do the above steps, it will be saved for the current session,
to save it permanently set it in config.php http://wiki.phpmyadmin.net/pma/Config#Order