Data Processing Engine, Batch Management, and Monitor Workflow Services

Data Processing Engine and Batch Management help automate your business processes. Use objects, APIs, Platform Events, and invocable actions to define, run, and review Data Processing Engine definitions and Batch Management jobs.

Required Editions
Available in: Lightning Experience
Available in: View product and edition availability for Data Processing Engine.
Available in: View product and edition availability for Batch Management.

Here’s how both these features can automate your business processes:

Data Processing Engine: Transform data that’s available in your Salesforce org and write back the transformation results as new or updated records. You can transform the data for standard and custom objects.
Batch Management: Automate the processing of records in scheduled flows. You can process a high volume of standard and custom object records.

Once a Data Processing Engine definition is run or a Batch Management job is run, you can view the progress of the run and the results of the run using Monitor Workflow Services.

Data Model

Data Processing Engine, Batch Management, and Monitor Workflow Servics share a data model. Let’s learn about the objects and relationships in this shared data model.
Common Tooling API Object

BatchJobDefinition is a common Tooling API object that is shared between Data Processing Engine and Batch Management.
Common Platform Event

Batch Management jobs and Data Processing Engine definitions are run using invocable actions in Flows. Use the BatchJobStatusChanged event to notify subscribers after a Batch Management job or a Data Processing Engine definition is processed in a flow.
Common Business APIs

Common Business APIs are RESTful APIs that are sometimes available as Apex classes and methods.
Data Processing Engine

Transform data that’s available in your Salesforce org and write back the transformation results as new or updated records. You can transform the data for standard and custom objects. Data Processing Engine consists of a Tooling API object, a standard object, a Metadata API, and an invocable action. You can use these to view, create, edit, and run Data Processing Engine definitions.
Batch Management

Automate the processing of records in scheduled flows. You can process a high volume of standard and custom object records. Batch Management consists of three Tooling API objects, a standard object, a Metadata API, and an invocable action. You can use these resources to view, create, edit, and run Batch Management jobs.
Monitor Workflow Services

The Monitor Workflow Services standard objects can be used to track the run of Data Processing Engine definitions and Batch Management jobs. During a run, you can view details about each part that the run is broken down into. After the run is complete, you can view its status and the records which weren’t processed during the run.