Bigquery streaming data delays

人盡茶涼 提交于 2019-12-24 07:44:13

问题


I'm streaming data into a bigquery table, for some reason last few times I checked the data isn't available instantly. The streamed data eventually is available to query, sometimes it looks like it's more than an hour out of sync. But data does eventually appear after some delays.

Is this expected? If it is, what are the ways around it? The table is partitioned by date and we are not "load"-ing data into any particular partition, we are streaming data only for the current day.

Update:

When I say data is not available, I mean running following query doesn't seem to match date/time the data was pushed to Bigquery.

select   max(dateTime) from [nproj.reporting] ;

来源:https://stackoverflow.com/questions/39407558/bigquery-streaming-data-delays

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!