I currently have a PCM audio in the form of a byte array. The format is signed 16 bit little endian. I would like to convert this to some playable format on the Android, pre
http://developer.android.com/reference/android/media/AudioTrack.html
This class looks like it has exactly what you need!
write(byte[] audioData, int offsetInBytes, int sizeInBytes)
Writes the audio data to the audio hardware for playback.
EDIT
Change your stream to AudioManager.STREAM_MUSIC
AudioManager.STREAM_MUSIC