Accelerated Data Ingestion (Beta)

Data 360 accelerates data ingestion by moving all data from its Data Lake Objects (DLOs) directly into the real-time layer. This eliminates the need to wait for the standard Data 360 pipeline to process the data. As a result, organizations can access fresh and updated 360-degree user profiles instantly, facilitating effective agentic conversations and triggering timely user communications without delays caused by extended data processing times.

With this feature enabled, once data is ingested into Data 360 Data Lake Objects (DLOs) from non-real-time sources such as CRM, Kafka, Kinesis, S3 batch, and others, within approximately one minute of landing in the DLO, the data becomes available in the real-time layer. This ensures that the ingested data is ready for real-time operations, including identity resolution, calculated insights, segmentation, and actions. The DLO direct ingestion is enabled for both batch and streaming modes, so that time bound use cases like quick customer 360 profile updates for agentic conversations, web personalisation, in workflow triggers and notifications, can be met using all your data.

  1. Enable the feature in the Feature Manager.

    1. In Data Cloud Set Up, under Feature Management, select Feature Manager.
    2. Navigate to the Accelerated Data Ingestion feature and click Enable.

  2. Enable Real-Time Data Ingestion for specific Data Graphs.

    1. When creating or editing a Real-Time Data Graph (RT-DG), navigate to the Real Time Consumption Limits screen.
    2. Toggle the Real-Time Data Ingestion button to ON.