Exercise 4: Ingest Orders from Amazon S3

In this exercise, you’ll ingest Pronto orders from Amazon S3 into Data 360, create a custom Orders data model object, and relate it to Individual so you can analyze orders per customer.

Step 1: Create the Order data stream

In this step, you'll create a data stream that ingests orders from Amazon S3.

1. Click the Data Streams tab.

2. Click New.

3. Under Other Sources, click Amazon S3, and click Next.

4. Configure the data stream with the following values:

   Field	Value
   Connection	Pronto S3 Connection
   File Type	CSV
   Import from Directory	Leave blank
   File Name	pronto_order_data.csv
   Source	Leave the default value: AwsS3_Pronto_S3_Connection

   

5. Click Next.

6. Continue configuring the data stream (keep the default values for any fields not listed below):

   Set the object values:

   Field	Value
   Data Lake Object Label	Order
   Data Lake Object API Name	Keep default

   Set the properties:

   Field	Value
   Category	Engagement
   Event Time Field	Order Date
   Primary Key	Order id

   Use the screenshot below to make sure you set all the right values.

   

7. Click Next.

8. Keep the default values, and click Deploy.

Step 2: Create a custom data model object

When you have industry-specific objects that don't have an equivalent in the Customer 360 Data Model, you can extend the Customer 360 Data Model with custom data model objects. In this step, you'll create a custom data model object to represent orders.

1. From the Orders data stream, click the Start button in the Data Mapping panel.

2. In the data model entities panel, click the Select Objects button.

3. Click the Custom Data Model tab.

4. Click New Custom Object.

   

5. Keep the default selection and click Save.

   

6. Examine the mappings. Because the Order custom data model object (DMO) was created based on your Orders data lake object (DLO), each field in the data lake object has been automatically mapped to its corresponding field in the data model object.

   

7. Click Save & Close.

Step 3: Create the Order-to-Individual relationship

In this step, you'll create a many-to-one relationship between the Order object and the Individual object.

1. Click the Data Model tab.

2. Click the Order data model object (DMO).

3. Click the Relationships tab.

4. Click New.

5. In the Edit Relationships dialog, click the + New Relationship button.

6. Configure your relationship as follows:

   Field	Value
   Field	Customer Id
   Cardinality	N:1
   Related Object	Individual
   Related Field	Individual Id

   

7. Click Save & Close.

8. To visualize the new relationship, click the Data Model tab, click the Display as menu icon, and select Graph.

   

9. Make sure that the Order data model object (DMO) has a many-to-one relationship with the Individual DMO.

   

Summary

In this exercise, you created a data stream that ingests orders from Amazon S3 into an Orders data lake object (DLO). Because the Customer 360 Data Model doesn't have a standard data model object to represent orders, you created a custom Order data model object. You then defined a many-to-one relationship between the Order and the Individual data model objects.