Please migrate off JSON-RPC and Global HTTP Batch Endpoints - Dataflow Template

﹥>﹥吖頭↗ 提交于 2019-12-12 01:15:16

问题


I received an email with the Title ^ as the subject. Says it all. I'm not directly using the specified endpoint (storage@v1). The project in question is a postback catcher that funnels data into BigQuery

App Engine > Pub Sub > Dataflow > Cloud Storage > BigQuery

Related question here indicates Dataflow might be indirectly using it. I'm only using the Cloud PubSub to GCS Text template.

What is the recommended course of action if I'm relying on a template?


回答1:


I think the warning may come from a dataflow job which uses the old version of storage API. Please upgrade Dataflow/Beam SDK version beyond 2.5.

Since you're using our PubsubToText template. The easiest way to to it would be:

  1. Stop your pipeline. Be sure to select "Drain" when asked.
  2. Relaunch the pipeline using the newest version (which is automatically done if you're using UI), from the same subscription.
  3. Check the SDK version. It should be at least 2.7.

After that you should not see any more warnings.



来源:https://stackoverflow.com/questions/52934591/please-migrate-off-json-rpc-and-global-http-batch-endpoints-dataflow-template

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!