Capture RGB from Kinnect with Openni and show with OpenCV

Question

I need to capture the color RGB image from a Kinnect camera, but I want to show it in OpenCV as this is only a part of a bigger program. I know OpenCV has compatibility with Ope

Answer 1

Following up on @Jav_Rock's answer above, for IR and Depth the solution is similar, except for the following (in place of SENSOR_COLOR, CV_8UC3 and RGB888Pixel, respectively):

Depth

• Sensor type: SENSOR_DEPTH
• OpenCV type: CV_16UC1
• VideoFrameRef data: DepthPixel

Note you'll probably want to set the PixelMode for the VideoStream's VideoFormat to PIXEL_FORMAT_DEPTH_100_UM otherwise your depth image will look very black.

IR

• Sensor type: SENSOR_IR
• OpenCV type: CV_16UC1
• VideoFrameRef data: Grayscale16Pixel

Finally, note that neither depth nor IR need the cv::cvtColor call.