Create a Google BigQuery Data Stream

Start the flow of data by creating a data stream for your Google BigQuery data source. The data stream creates a data lake object (DLO) in Data 360 that you can map to the Customer 360 Data Model to use across Data 360.

This connector supports the zero copy connection method.

User Permissions Needed
To create a connection:Data Cloud Architect permission set

Before you begin:

  • Make sure that the required Google BigQuery connection is set up.

  1. In Data Cloud, on the Data Streams tab, click New.

    You can also use App Launcher to find and select Data Streams.

  2. Under Other Sources, select the Google BigQuery connection source, and click Next.

  3. Select from the available Google BigQuery connections.

  1. Select the objects you want to connect.

  2. Confirm the Source details, then click Next.

  3. For each object, complete the required fields.

    • Add a label and API name for the Data Lake Object.

    • Select a category from profile, engagement, or other.

    • Select a primary key.

    • (Optional) Select an Organization Unit Identifier from the dropdown.

    • (Optional) Select the Supported Fields to connect.

  4. Click Next.

  5. Select a data space from the dropdown.

  6. Enable or disable acceleration. Acceleration uses caching to improve performance by storing data in a temporarily storing it in a data lake object.

    • To disable, uncheck the box.

    • To enable, add a frequency from the dropdown and enter a time as needed. Optionally select whether to refresh the initial file immediately.

  7. Click Deploy.

You can confirm your data stream was successful by reviewing the Last Run Status on the Data Stream record page. When the Last Run Status displays success, you can see how many records were processed and the total number of records that were loaded.

You can now map the created DLO to the data model to use the data in segments, calculated insights, and other use cases.