using gstreamer with python opencv to capture live stream?

问题

First of all i have python 3 with the library Gstreamer in it.

print(cv2.getBuildInformation())

it shows Gstreamer with YES next to it.

Here is the transmitter code using gstreamer in rasperryPi 3:

gst-launch-1.0 v4l2src device="/dev/video0" ! video/x-raw,width=320,height=240 ! videoconvert ! x264enc tune=zerolatency ! rtph264pay ! udpsink host='my ip address' port=10000

and i will be using a python code to determine shapes , recognize objects .. etc

here is my python code:

import numpy as np
import cv2




def receive():
cap = cv2.VideoCapture("udpsrc port=10000 ! application/x-rtp,encoding-name=H264 ! rtpjitterbuffer ! rtph264depay ! avdec_h264 ! videoconvert ! ximagesin ", cv2.CAP_GSTREAMER)

while True:

    ret,frame = cap.read()

    if not ret:
        print('empty frame')
        continue 


    cv2.imshow('receive', frame)
    if cv2.waitKey(1)&0xFF == ord('q'):
        break


cap.release()



receive();

but it shows always shows empty frame.

when i tried this command on terminal:

gst-launch-1.0 udpsrc port=10000 ! application/x-rtp,encoding-name=H264 ! rtpjitterbuffer ! rtph264depay ! avdec_h264 ! videoconvert ! ximagesink

it works just fine, so the problem is on my python end.

so what do you recommend?

回答1:

cap = cv2.VideoCapture('udpsrc port=7000 caps = "application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, payload=(int)96" ! rtph264depay ! decodebin ! videoconvert ! appsink', cv2.CAP_GSTREAMER)

use this pipeline, it will work just fine. change the port to the one you are using.

回答2:

I use different send-receive scripts that give me way better video latency (allso at higher resolutions) when run from commandline, but I have no clue how to import the resulting stream into OpenCV on the Ubuntu end.

(My OpenCV is also installed with ffmpeg and gstreamer ON.)

My GStreamer transmitter code on my Raspberry pi:

gst-launch-1.0 -v v4l2src ! video/x-raw,width=320,height=240 ! videoconvert ! jpegenc ! rtpjpegpay ! udpsink host=192.168.1.101 port=5200

My Gstreamer Receiver code at the Ubuntu 16.04 end:

gst-launch-1.0 -v udpsrc port=5200 ! application/x-rtp, encoding-name=JPEG,payload=26 ! rtpjpegdepay ! jpegdec ! videoconvert ! autovideosink

I hope this will help you improve your stream quality and latency. And I hope somebody may be able to sample me the OpenCV pipeline import code :)

Greetings, Peter Lunk

来源：https://stackoverflow.com/questions/52879501/using-gstreamer-with-python-opencv-to-capture-live-stream

标签

python

OpenCV

gstreamer