Create a Snowflake Data Stream
Create a data stream to start the flow of data from your Snowflake source to Data Cloud.
User Permissions Needed | |
---|---|
To create a Snowflake data stream: | Data Cloud Admin OR Data Cloud Data Aware Specialist |
Before you begin:
- Make sure that the Snowflake connection is set up.
- Review the IP addresses to make sure the Snowflake connection has the necessary access.
-
In Data Cloud, on the Data Streams tab, click New.
You can also use App Launcher to find and select Data Streams.
-
Select Snowflake as the source of the data stream, and click Next.
-
Select from the available Snowflake connections.
-
Select the database that you want to use.
-
Select the objects that you want to include, and click Next.
-
Select the category to specify the type of data to ingest.
-
For Primary Key, select a unique field to identify a record.
-
(Optional) Select a record modified field.
If data is received out of order, the record modified field provides a reference point to determine whether to update the record. The record with the most up-to-date timestamp is loaded.
-
(Optional) For Organization Unit Identifier, select a business unit to use in a record’s data lineage.
-
Select the source fields, and click Next.
Fields with convertible data types are listed under Supported Fields.
-
For Data Space, if the default data space isn’t selected, assign the data stream to the appropriate data space.
-
If you want to query the data in your Snowflake account with reduced latency, keep the Enable acceleration option checked, and choose the acceleration schedule.
-
Click Deploy.
You can now map your data lake object to the semantic data model to use the data in segments, calculated insights, and other use cases.