Creating/Writing to Parititoned BigQuery table via Google Cloud Dataflow

前端 未结 6 1356
死守一世寂寞
死守一世寂寞 2020-11-29 12:25

I wanted to take advantage of the new BigQuery functionality of time partitioned tables, but am unsure this is currently possible in the 1.6 version of the Dataflow SDK.

6条回答
  •  孤城傲影
    2020-11-29 13:02

    If you pass the table name in table_name_YYYYMMDD format, then BigQuery will treat it as a sharded table, which can simulate partition table features. Refer the documentation: https://cloud.google.com/bigquery/docs/partitioned-tables

提交回复
热议问题