Bulk Ingestion

With the Customer Data Platform Bulk Ingestion API, you can upsert or delete large data sets. Prepare a CSV file representation of the data you want to upload, create a job, upload job data, and let Salesforce take care of the rest.

Bulk Jobs and Operations

The Bulk Ingestion API upserts or deletes data in the Customer Data Platform using jobs. A bulk job typically goes through following stages:
  • Create a job to specify the object type of the data being processed and the operation that’s performed on the data. The operations supported are upserting bulk data or deleting bulk data.
  • After the job is created upload data in CSV format to the job.
  • To signal the data is ready to be processed, close the job. You can choose to abort the job if necessary.
  • Monitor the progress of the job and act on any failed records.
  • Delete a job.

Prepare CSV Files

Lists the field names for the object that you're processing in the first row in the CSV file. Each subsequent row corresponds to a record in your Customer Data Platform data lake. All the records in a CSV file must be for the same object. You specify this object when you first create the job.
  • Include all required fields when you create a record.
  • Each field-name header in the file must be the same as the Datasource Object's field names. Results only include columns that are a match.
  • Updating records works as a full replace. Patch semantics aren’t supported.
  • Files must be in UTF-8 format. Upload data must not exceed 150 MB.
  • CSV files are expected to be formatted according to RFC 4180, Common Format, and MIME Type for CSV Files.
  • Only supports comma field delimiters.
  • Empty field values are set to null.

Example