Create a Snowflake File Federation Data Stream (Beta)
Create a file federation data stream to start the flow of data from your Snowflake source to Data Cloud.
| User Permissions Needed | |
|---|---|
| To create a Snowflake data stream: | Data Cloud Admin |
Before you begin:
- Make sure that the Snowflake file federation connection is set up.
- Review the IP addresses to make sure the Snowflake connection has the necessary access.
-
In Data Cloud, on the Data Streams tab, click New.
-
Select Snowflake File Federation as the source of the data stream, and click Next.
-
From the dropdown menus, select the connection and the database to use.
-
Under Schemas, select the schema to use.
-
From the Available Objects, select the objects you want to include.
-
Click Next.
You can’t choose objects listed under In Use Objects.
-
Enter the object name and object API name. For more information, see Data Lake Object Naming Standards.
-
Select the category to specify the type of data to ingest. For more information, see Category.
-
Select a primary key to uniquely identify the incoming records. For more information see, Primary Key.
-
Select the source fields you want to ingest and click Next. Fields with convertible data types are listed under Supported Fields. See the Data Type Compatibility table for more information on data type mapping between Snowflake and Data Cloud.
Fields whose data types are not supported in Data Cloud get listed under Unsupported Fields. It's recommended to map all fields of supported types from the table during datastream creation.
-
Select the relevant data space. Choose Default for data space if you don’t have any other data space provisioned in your org. For more information, see Data Spaces.
-
Click Deploy.
This table lists the mapping of Snowflake data types with Data Cloud data types.
| Snowflake Data Type | Is Auto-mapped to Data Cloud Data Type |
|---|---|
| NUMBER, DECIMAL, NUMERIC | Number |
| INT, INTEGER, SMALLINT, TINYINT, BYTEINT | Number |
| BIGINT | Number |
| FLOAT, FLOAT4, FLOAT8, DOUBLE, DOUBLE PRECISION, REAL | Number |
| VARCHAR, CHAR, CHARACTER, STRING, TEXT | Text |
| TIMESTAMP_LTZ | DateTime |
| DATE | Date |
| BOOLEAN | Boolean |
| TIME | Not Suported |
| VARIANT, OBJECT, ARRAY, GEOGRAPHY, GEOMETRY | Not Supported |
| BINARY, VARBINARY | Not Supported |