(Beta) Amazon Kinesis destination

Overview

The Kinesis Data Streams service by Amazon Web Services allows you to collect and process large streams of data records in real time.

You can create a real-time outbound connection to your Amazon Kinesis storage to stream data from Adobe Experience Platform.

• For more information about Amazon Kinesis, see the Amazon documentation.
• To connect to Amazon Kinesis using API calls, see the Streaming destinations API tutorial.
• To connect to Amazon Kinesis using the Platform user interface, see the sections below.

Use Cases

By using streaming destinations such as Amazon Kinesis, you can easily feed high-value segmentation events and associated profile attributes into your systems of choice.

For example, a prospect downloaded a white-paper which qualifies them into a “high-propensity to convert” segment. By mapping the segment that the prospect falls in to the Amazon Kinesis destination, you would receive this event in Amazon Kinesis. There, you can employ a do-it-yourself approach and describe business logic on top of the event, as you think would work best with your enterprise IT systems.

Export Type

Profile-based - you are exporting all members of a segment, together with the desired schema fields (for example: email address, phone number, last name), as chosen from the select attributes screen of the destination activation workflow.

Connect destination

See Cloud storage destinations workflow for instructions on how to connect to your cloud storage destinations, including those supported by Amazon.

For Amazon Kinesis destinations, enter the following information in the create destination workflow:

In the Authentication step

• Amazon Web Services access key and secret key: In Amazon Web Services, generate an access key - secret access key pair to grant Platform access to your Amazon Kinesis account. Learn more in the Amazon Web Services documentation.
• region: Indicate which Amazon Web Services region to stream data to.

In the Setup step

• Name: Provide a name for your connection to Amazon Kinesis
• Description: Provide a description for your connection to Amazon Kinesis.
• stream: Provide the name of an existing data stream in your Amazon Kinesis account. Platform will export data to this stream.

Activate segments

See Activate profiles and segments to a destination for information about the segment activation workflow.

Exported data

Your exported Experience Platform data lands in Amazon Kinesis in JSON format. For example, the event below contains the email address profile attribute of an audience that has qualified for a certain segment and exited another segment. The identities for this prospect are ECID and email.

{
  "person": {
    "email": "yourstruly@adobe.con"
  },
  "segmentMembership": {
    "ups": {
      "7841ba61-23c1-4bb3-a495-00d3g5fe1e93": {
        "lastQualificationTime": "2020-05-25T21:24:39Z",
        "status": "exited"
      },
      "59bd2fkd-3c48-4b18-bf56-4f5c5e6967ae": {
        "lastQualificationTime": "2020-05-25T23:37:33Z",
        "status": "existing"
      }
    }
  },
  "identityMap": {
    "ecid": [
      {
        "id": "14575006536349286404619648085736425115"
      },
      {
        "id": "66478888669296734530114754794777368480"
      }
    ],
    "email_lc_sha256": [
      {
        "id": "655332b5fa2aea4498bf7a290cff017cb4"
      },
      {
        "id": "66baf76ef9de8b42df8903f00e0e3dc0b7"
      }
    ]
  }
}