Create an IBM Cloud Object Storage Data Stream (Beta)

Start the flow of data by creating a data stream for your IBM Cloud Object Storage data source. The data stream creates a data lake object (DLO) in Data 360 that you can map to the Customer 360 Data Model to use across Data 360.

This feature is a Beta Service. A customer may opt to try a Beta Service in its sole discretion. Any use of the Beta Service is subject to the applicable Beta Services Terms provided at Agreements and Terms. If you have questions or feedback about this Beta Service, contact the Data 360 Connector team at datacloud-connectors-beta@salesforce.com.
User Permissions Needed 
To create a connection:Data Cloud Architect

Before you begin:

  1. In Data Cloud, on the Data Streams tab, click New.

    You can also use App Launcher to find and select Data Streams.

  2. Under Other Sources, select the IBM Cloud Object Storage connection source, and click Next.

  3. Select from the available IBM Cloud Object Storage connections.

  4. Enter the file details.

    • For Bucket, enter the name of the bucket where the object is located. Ensure the API key is configured for this bucket.
    • For Object Name, enter a single CSV file name. For example, abc.csv.

  5. Enter the source details.

    • For Source, enter the external system where data is sourced. Multiple data streams can have the same source.

  6. Click Next.

  7. Create a data lake object (DLO) or select an existing one.

    If you’re creating a DLO, see naming standards. If you’re using an existing DLO, see Using existing data lake object to create a data stream.

  8. Under Object Details, for category, identify the type of data in the data stream.

  9. For primary key, select a unique field to identify a source record.

    If a composite key is required or a key doesn’t exist, you can create one using a formula field. See Create a Formula Field or Use Case 2: Create a Primary Key.

  10. (Optional) Select a record modified field.

    If data is received out of order, the record modified field provides a reference point to determine whether to update the record. The record with the most up-to-date timestamp is loaded.

  11. (Optional) To identify the data lineage of a record’s business unit, add the organization unit identifier.

  12. Click Next.

  13. For Data Space, if the default data space isn’t selected, assign the data stream to the appropriate data space.

  14. Click Deploy.

When the Last Run Status displays success, you can see how many records were processed and the total number of records that were loaded.

You can now map the created DLO to the data model to use the data in segments, calculated insights, and other use cases.