Behavioral Data Integration Best Practices

This page contains information regarding implementing best practices for the integration of behavioral data from Marketing Cloud into your external system. You can get data out of Marketing Cloud via data extract or a SOAP API tracking data retrieve call.

Prerequisites

You need an account enabled to use the SOAP API.

Scenario

Jen uses a tracking send summary to retrieve information regarding her triggered send results. While this solution worked for a smaller implementation, Jen has expanded the integration between her internal system and Marketing Cloud, and she is noticing a longer period of time for her API calls to retrieve the desired results. She also notices that the retrieval process requires more calls beyond the initial request. After consulting the Marketing Cloud documentation, she decides to implement a data extract procedure on a set schedule.

What are Behavioral Data Integration Best Practices

The information below outlines the attributes of both data extracts and SOAP API retrieve calls and demonstrates the situations in which either solution would be most appropriate. Use this information as a guide to determine which solution best applies to your Marketing Cloud account and make use of it to retrieve the necessary data.

How to Implement Behavioral Data Integration Best Practices

Review the attributes listed below and take the appropriate steps to ensure the most timely and effecient delivery of behavioral tracking data to the system of your choice.

Data Extracts

Data extracts permit you to retrieve selected tracking information from Marketing Cloud via a compressed data file on placed on either a Marketing Cloud FTP site or an external location. You can choose which events are contained within the data extract. That compressed file contains delimited files (such as comma- or tab-delimited) and can be encrypted. You can automate data extracts from Marketing Cloud or create and trigger the process via the SOAP API. Common data extract recurrence options include daily or hourly, depending on the volume of data being extracted and the need for timely data. The Marketing Cloud system can perform incremental data extracts, allowing you to retrieve only that data that has been created since the previous data extract.

SOAP Retrieve Calls

Use SOAP Retrieve calls to retrieve data directly to an application without using data extract files and FTP sites. Retrieves can only be performed as a synchronous operation, as no asynchronous retrieve option is available. Retrieve calls can also use incremental settings, meaning that the call returns only data created after the previous call. Depending on your language and development environment, you can use SOAP response compression for these calls. However, you must create a call for each event type, and each call returns a maximum of 2500 results per call. You must make multiple retrieve requests until all data has been retrieved. Each call generally averages a response time of 1 second.

Choosing Between Data Extracts and SOAP Retrieve Calls

Use the bullet points below as an aid to determine the best data integration method for your needs:

Data Extract

  • Use when sending more than 1,000,000 emails per hour
  • Data can be extracted on regular intervals, such as hourly or daily
  • You need encrypted data files

SOAP Retrieve Call

  • Use when sending lessthan 1,000,000 emails per hour.
  • You need the most recent data.
  • You don't require encrypted data files.