Ingest Data
Load data records into your Data Cloud programmatically using the Ingestion API or configure an S3 connector with retrieval schedule in order to pull records from S3.
-
The Ingestion API provides a RESTful interface that supports both streaming and bulk interaction patterns for loading data into Data Cloud. You can use a single Ingestion API connector for performing both bulk and streaming uploads.
-
Create an Amazon S3 Data Stream
Create a data stream to programmatically stream data from an Amazon S3 data source. With the data stream you can ingest data into your Data Cloud data lake.
-
Rotation of S3 Credentials with Metadata API
Use the Metadata API to rotate the S3 credentials and enable access to AWS. To update the S3 credentials you must retrieve the metadata of S3 connectors, modify the S3 credentials, and deploy the metadata.