Steaming insert / insertAll - long delay?

自作多情 提交于 2019-12-13 02:11:12

问题


I'm streaming data into a table on BigQuery from the google api for python.

I get a 200 OK with no 'insertErrors' key in the response from bigQuery:

{u'kind': u'bigquery#tableDataInsertAllResponse'}

If I query my table there are only 2 rows, despite me having inserted several additional records a little while ago (20 minutes+).

I can't see any errors anywhere - can someone advise me on how to debug this issue?


回答1:


I found a solution here: https://stackoverflow.com/a/19145783/1607103

I resolved the issue I was experiencing by creating a new dataset and new tables within it. Everything is now working perfectly and data is visible seconds after adding it. I am at a stage in my project where table structures are changing frequently, which seems to be the cause of the issue. I will ensure that modified tables have different names for now.

I am extremely concerned that bigquery is experiencing issues with no visibility. It doesn't fill me with confidence that there are no errors and there is no indication (that I am aware of) that something is going wrong.



来源:https://stackoverflow.com/questions/22867090/steaming-insert-insertall-long-delay

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!