use docker for google cloud data flow dependencies

Question

I am interested in using Google cloud Dataflow to parallel process videos. My job uses both OpenCV and tensorflow. Is it possible to just run the workers inside a docker ins

Answer 1

One solution is to issue the pip install commands through the setup.py option listed for Non-Python Dependencies.

Doing this will download the manylinux wheel instead of the source distribution that the requirements file processing will stage.