Using an Android (2.3.3) phone, I can use the camera to retrieve a preview with the onPreviewFrame(byte[] data, Camera camera) method to get the YUV image.
onPreviewFrame(byte[] data, Camera camera)
Have you considered using OpenCV's Android port? It can do a lot more than just color conversion, and it's quite fast.