This question came up on stackexchange security, one of the suggestions was to use Keystore explorer
https://security.stackexchange.com/questions/3779/how-can-i-export-my-private-key-from-a-java-keytool-keystore
Having just tried it, it works really well and I strongly recommend it.