Have a look at the CMU Sphinx Python library. It's developed in Java so I think that the Python libs are just wrappers for that. The project has a lot of ongoing research behind it.
Official wiki: http://cmusphinx.sourceforge.net/wiki/
Quick-start tutorial for linux here: http://probing.wikidot.com/speech-recognition-using-sphinx3-and-python