snowflake-data-warehouse

When connecting to Snowflake internal stage I am seeing it connect to a different db

徘徊边缘 提交于 2020-03-05 06:07:25
问题 I am connecting through newly released Snowflake Kafka connector using standalone mode. The connector is able to connect to my snowflake account successfully but when it looks for creating internal stage, it doesn't use correct database as in config This is the content of new connector.properties file: name=kafkaSnowNow connector.class=com.snowflake.kafka.connector.SnowflakeSinkConnector tasks.max=8 topics=kafkaSnow1,kafkaSnow2 snowflake.topic2table.map= kafkaSnow1:kafka_db.kafka_schema

When connecting to Snowflake internal stage I am seeing it connect to a different db

让人想犯罪 __ 提交于 2020-03-05 06:06:19
问题 I am connecting through newly released Snowflake Kafka connector using standalone mode. The connector is able to connect to my snowflake account successfully but when it looks for creating internal stage, it doesn't use correct database as in config This is the content of new connector.properties file: name=kafkaSnowNow connector.class=com.snowflake.kafka.connector.SnowflakeSinkConnector tasks.max=8 topics=kafkaSnow1,kafkaSnow2 snowflake.topic2table.map= kafkaSnow1:kafka_db.kafka_schema

How does Snowflake handle NULL values?

无人久伴 提交于 2020-03-05 05:59:28
问题 For example, in my dataframe I have a column of NULL values that I plan to edit later, let's say for letter grades. Here is some example for now: import csv import pandas as pd import numpy as np df = pd.read_csv('MOCK_DATA.csv') df.head() id first_name last_name email null field blank_field 0 1 Paule Tohill ptohill0@macromedia.com False NaN 1 2 Rebe Slyford rslyford1@washington.edu True NaN 2 3 Angelita Antoni aantoni2@google.pl False NaN 3 4 Giffy Dehm gdehm3@berkeley.edu False NaN 4 5 Rob

Generating unique log files when running SnowSQL

前提是你 提交于 2020-01-25 10:21:09
问题 (submitting on behalf of a Snowflake User) I understand that you can configure log files by following this documentation (https://docs.snowflake.net/manuals/user-guide/snowsql-config.html#configuration-options-section) and the following snippet: | log_bootstrap_file | ~/.snowsql/log_... | SnowSQL bootstrap log file location | | log_file | ~/.snowsql/log | SnowSQL main log file location BUT(!) is there a way to save log file of different jobs under different paths? Any recommendations would be

Staged Internal file csv.gz giving error that file does not match size of corresponding table?

假装没事ソ 提交于 2020-01-25 10:13:11
问题 I am trying to copy a csv.gz file into a table I created to start analyzing location data for a map. I was running into an error that says that there are too many characters, and I should add a on_error option. However, I am not sure if that will help load the data, can you take a look? Data source: https://data.world/cityofchicago/array-of-things-locations SELECT * FROM staged/array-of-things-locations-1.csv.gz CREATE OR REPLACE TABLE ARRAYLOC(name varchar, location_type varchar, category

Snowflake SQL Regex ~ Extracting Multiple Vals

孤街醉人 提交于 2020-01-25 07:22:16
问题 I am trying to identify a value that is nested in a string using Snowflakes regexp_substr() The values that I want to access are in quotes: ... Type: a: - !<string> val: "A" - !<string> val: "B" - !<string> val: "C" ... *There is a lot of text above and below this. I want to extract A, B, and C for all columns. But I am unsure how. I have tried using regexp_substr() but haven't been able to isolate past the first value. I have tried: REGEXP_SUBSTR(col, 'Type\\W+(\\w+)\\W+\\w.+\\W+\\w.+')

Clone Snowflake metadata only

邮差的信 提交于 2020-01-25 03:09:05
问题 I want to clone the shell of a Snowflake database (metadata only, no data). Is this possible? I have checked the documentation and haven't found a solution. 回答1: If you're just trying to get an empty shell of an existing database, you could clone the entire database, and then script out a truncate of all of the tables that exist in the database. The clone doesn't add any data, and the truncate would be very quick on the clone (while not affecting the original tables). 来源: https:/

Open workbooks have been flushed by Snowflake

别说谁变了你拦得住时间么 提交于 2020-01-24 20:54:28
问题 I had a lot of open worksheets in the snowflake datawarehouse but now I don't see any. How do I recover those worksheets? I'm hoping there would be a provision folder for the same on the local computer. 回答1: Try clicking on the small arrow on the top left and check under Recent worksheets Also, your worksheets should be stored under worksheet_data (run ls @~/worksheet_data to list them). 回答2: worksheets are actually stored in the user stage, and users can directly modify this stage, so this

Snowflake Snowpro Certifiction [closed]

雨燕双飞 提交于 2020-01-17 14:46:10
问题 Closed . This question needs to be more focused. It is not currently accepting answers. Want to improve this question? Update the question so it focuses on one problem only by editing this post. Closed 9 days ago . I worked on Vertica, IBM IAS that are MPP databases. They are similar to Redshift; I've been reading Snowflake documentation lately. Can anyone suggest how to take Snowpro Certification without real time project experience? Snowflake conducts classroom/online training but they are

Snowflake Snowpro Certifiction [closed]

陌路散爱 提交于 2020-01-17 14:45:05
问题 Closed . This question needs to be more focused. It is not currently accepting answers. Want to improve this question? Update the question so it focuses on one problem only by editing this post. Closed 9 days ago . I worked on Vertica, IBM IAS that are MPP databases. They are similar to Redshift; I've been reading Snowflake documentation lately. Can anyone suggest how to take Snowpro Certification without real time project experience? Snowflake conducts classroom/online training but they are