Set Up an Amazon Kinesis Connection

Create an Amazon Kinesis connection to pull in data from Kinesis data streams into Data Cloud.

User Permissions Needed 
To create an Amazon Kinesis connection:Data Cloud Admin OR Data Cloud Marketing Admin

Before you begin:

  • Make sure the Amazon Kinesis connector is enabled. For more information, see Enable Data Cloud Features.
  • Review the IP addresses to make sure the Amazon Kinesis connection has the necessary access.
  1. In Data Cloud, click Setup, and select Data Cloud Setup.

  2. Under Configuration, select More Connectors.

  3. Click New.

  4. On the Source tab, select Amazon Kinesis and click Next.

  5. Enter a connection name and connection API name, and provide the authentication and connection details.

    1. Enter the AWS access key ID and secret access key to authenticate.

      You must use the ID and secret access key together.

    2. Enter the name of your Kinesis stream for the AWS account that you want Data Cloud to read data from.

    3. Enter the region where your AWS Kinesis exists.

    4. Enter the Amazon Kinesis data stream service endpoint to connect programmatically to an AWS service.

  6. To review your configuration, click Test Connection.

  7. Click Save.

After the connector details are accepted, the connection is created and ready to use. It’s listed under More Connectors.

A Data Aware Specialist can now create data streams.

When working with the Amazon Kinesis connector, keep these behaviors in mind.

  • The Amazon Kinesis connector can’t read nested JSON.
  • An Amazon Kinesis connector can have only a single object in its schema.
  • You can’t reuse an Amazon Kinesis source in multiple Amazon Kinesis connections in Data Cloud.
  • An Amazon Kinesis stream can contain only the type of data that’s selected when the data stream is created. Any variation in data that doesn’t match the schema causes the data stream to fail.