Is there Anyone that has experience with any open source, or relatively cheap voice recognition API for java? I\'m pretty much looking for something that will turn spoken words
sphinx is by far the best option available if you are on a budget. however it also makes a huge difference what models you use, how you tune them and how you tune your audio source. absolutely everything has to match otherwise it just wont work. given the problem you described id be willing to bet a substantial sum that you've got you got your models mixed up and your mic is not correctly calibrated. also, if you have an accent it probably will not work - this is not an issue with the decoder but with the acoustic models - if no one with a voice/accent similar to yours was included in the training data you'll get poor results.
that said, have you looked at their open source models page?
http://www.speech.cs.cmu.edu/sphinx/models/
depending on what you are trying to do you should be able to obtain about 90% accuracy on free speech with the 16kHz WSJ models and the gigaword LMs NVP. i caution however that ASR is a massive undertaking and hasn't yet reached commodity status.