BigQuery Data Transfer Service with BigQuery partitioned table [closed]

谁说胖子不能爱 提交于 2021-02-08 06:11:56

问题


I have access to a project within BigQuery. I'm looking to create a partitioned table by ingestion time, partitioned by day, then set up a BigQuery Data Transfers process that brings avro files in from multiple directories within a Google Cloud Storage Bucket.

I'm able to create a non partitioned table in BigQuery, and setup the Transfers correctly so that the table gets updated regularly. However when I have set up the table (via the console) to be partitioned by day on ingestion time, the same transfer process does not work.

I receive the error: "Failed to start job for table xxxxxxx with error INVALID_ARGUMENT: Incompatible table partitioning specification. Expects partitioning specification interval(type:day), but input partitioning specification is ; JobID: xxxxxxxxxxxx:bqts_xxxxxxxx-0000-xxxx-xxxx-xxxxxxxxxxxx"

I think using the command line is one possible solution, but are there any alternatives - e.g. by only using the console?

来源:https://stackoverflow.com/questions/64929742/bigquery-data-transfer-service-with-bigquery-partitioned-table

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!