Can I reliably query the Firebase intraday tables in BigQuery and get 100% of the event data?

Question

I have two Firebase projects (one iOS and one Android) feeding into Bigquery. I need to combine, flatten, and aggregate some specific data from both projects into one combin

Answer 1

I thought I would post the results of my testing this for a few months. Here are the basic mechanics as I see them:

1. New DAY1 intraday table is created at midnight GMT (xyz.app_events_intraday_20180101)
2. New DAY2 intraday table is created 24 hours later (xyz.app_events_intraday_20180102), but DAY1 intraday table sticks around for a few hours
3. Eventually, DAY1 table is "renamed" to xyz.app_events_20180101 and you are left with a single (current) intraday table

My tests have shown that additional data is added to the app_events_* tables, even after step 3 has taken place, so it is NOT safe to assume that the data is stable/static once the name has changed. I have new data appear up to 2 or 3 days later.