google-bigquery

Firebase User Engagement Calculation

天涯浪子 提交于 2020-07-30 02:58:27
问题 I am trying to wrap my head around the Firebase User Engagement Calculation. I am doing a lot of debugview testing now, and as the online documentation states (https://support.google.com/firebase/answer/6317485), Firebase is firing the user_engagement event by default on a periodic basis within a session while the app is in the foreground. What I have seen thusfar is that user_engagement is fired quite reliably in the beginning and end of an engagement (this can be occurring multiple times in

How to convert JSON file to new line delimited using Google Apps Script?

|▌冷眼眸甩不掉的悲伤 提交于 2020-07-23 06:48:05
问题 I have a standalone Google Script project that makes nested JSON from fetch URL. Original code by iAmOren. function unFlat(fj) { let date = Utilities.formatDate(new Date(), "GMT", "yyyy-MM-dd"); var arr=[]; var objL1, objL2, objL3; var prev_level; for(var i=0; i<fj.length;i++) { var obj=fj[i]; switch(Number(obj.level)) { case 3: objL3={}; objL3.name=obj.name; objL3.leads=obj.leads; objL3.cost=obj.cost; objL3.revenue=obj.revenue; objL2.place.push(objL3); prev_level=3; break; case 2: objL2={};

How to convert JSON file to new line delimited using Google Apps Script?

梦想与她 提交于 2020-07-23 06:46:00
问题 I have a standalone Google Script project that makes nested JSON from fetch URL. Original code by iAmOren. function unFlat(fj) { let date = Utilities.formatDate(new Date(), "GMT", "yyyy-MM-dd"); var arr=[]; var objL1, objL2, objL3; var prev_level; for(var i=0; i<fj.length;i++) { var obj=fj[i]; switch(Number(obj.level)) { case 3: objL3={}; objL3.name=obj.name; objL3.leads=obj.leads; objL3.cost=obj.cost; objL3.revenue=obj.revenue; objL2.place.push(objL3); prev_level=3; break; case 2: objL2={};

Max file count using big query data transfer job

耗尽温柔 提交于 2020-07-23 06:40:27
问题 I have about 54 000 files in my GCP bucket. When I try to schedule a big query data transfer job to move files from GCP bucket to big query, I am getting the following error: Error code 9 : Transfer Run limits exceeded. Max size: 15.00 TB. Max file count: 10000. Found: size = 267065994 B (0.00 TB) ; file count = 54824. I thought the max file count was 10 million. 回答1: I think that BigQuery transfer service lists all the files matching the wildcard and then use the list to load them. So it

Max file count using big query data transfer job

放肆的年华 提交于 2020-07-23 06:38:33
问题 I have about 54 000 files in my GCP bucket. When I try to schedule a big query data transfer job to move files from GCP bucket to big query, I am getting the following error: Error code 9 : Transfer Run limits exceeded. Max size: 15.00 TB. Max file count: 10000. Found: size = 267065994 B (0.00 TB) ; file count = 54824. I thought the max file count was 10 million. 回答1: I think that BigQuery transfer service lists all the files matching the wildcard and then use the list to load them. So it

Bigquery how to filter tables in dataset during List operation

China☆狼群 提交于 2020-07-23 06:35:20
问题 Is there any way to search or filter for particular Table from Dataset using Table name while calling List operation? I understand that documentation mentions use of Labels to filter Tables but in my case this will not suffice as there is no restriction on number of Tables that can be created under a Dataset with or without Label . I am using Node library for my operations. 回答1: The prefered way to search or filter for particular Table (or any other metadata object) is to query INFORMATION

Bigquery how to filter tables in dataset during List operation

荒凉一梦 提交于 2020-07-23 06:33:53
问题 Is there any way to search or filter for particular Table from Dataset using Table name while calling List operation? I understand that documentation mentions use of Labels to filter Tables but in my case this will not suffice as there is no restriction on number of Tables that can be created under a Dataset with or without Label . I am using Node library for my operations. 回答1: The prefered way to search or filter for particular Table (or any other metadata object) is to query INFORMATION

Data seems to be missing in Bigquery SEC Filing Dataset

不羁岁月 提交于 2020-07-23 06:18:11
问题 I was pleased recently to discover that Bigquery hosts a dataset of SEC filings. I am unable to find the actual text of the filings in the dataset however! This seems so obvious I must be missing something. As an example, the 2018 Microsoft 10-K filing on the SEC website itself can be seen to have the 10-K text in which Item 7 includes the phrase "Management’s Discussion and Analysis of Financial Condition and Results". I searched for this phrase in the Dataset. First, the following query

Data seems to be missing in Bigquery SEC Filing Dataset

给你一囗甜甜゛ 提交于 2020-07-23 06:17:06
问题 I was pleased recently to discover that Bigquery hosts a dataset of SEC filings. I am unable to find the actual text of the filings in the dataset however! This seems so obvious I must be missing something. As an example, the 2018 Microsoft 10-K filing on the SEC website itself can be seen to have the 10-K text in which Item 7 includes the phrase "Management’s Discussion and Analysis of Financial Condition and Results". I searched for this phrase in the Dataset. First, the following query

Data seems to be missing in Bigquery SEC Filing Dataset

 ̄綄美尐妖づ 提交于 2020-07-23 06:16:19
问题 I was pleased recently to discover that Bigquery hosts a dataset of SEC filings. I am unable to find the actual text of the filings in the dataset however! This seems so obvious I must be missing something. As an example, the 2018 Microsoft 10-K filing on the SEC website itself can be seen to have the 10-K text in which Item 7 includes the phrase "Management’s Discussion and Analysis of Financial Condition and Results". I searched for this phrase in the Dataset. First, the following query