DocumentationTutorialsUse Cases & Blueprints

Set up the source

Last update: September 11, 2026

CREATED FOR:

  • Developer
  • User
  1. Go to Adobe Experience Platform UI and navigate to Sources
  2. Click on Catalog in the top nav
  3. Select Streaming from the list of sources (ensure the All sources radio button is selected)
  4. Click on Setup / Add Data for the HTTP API

Sequence of steps to create a new HTTP API source account

Create HTTP API account

The first thing you need to do is create a new account. This account holds the details around how authentication is handled and if the data being streamed in is XDM compatible (i.e. already matching the structure of the underlying XDM schema)

Perform the following tasks:

  1. Select New Account and add the following details:
    • Account Name -> Streaming Ingestion - <Your Initials>
  2. Leave the toggle for Enable authentication disabled
  3. Leave the checkbox for XDM compatible unchecked
  4. Click the Connect to source button to continue
CAUTION
DO NOT toggle on the Enable authentication or check the box for XDM compatible. This breaks the lab

Your screen should look like this:

Screen after clicking Connect to source for the new HTTP API account

You should now see a green checkbox with the message “Connected”. Click the Next button in the upper right to continue setting up your dataflow:

Green checkbox with Connected message after setting up the HTTP API account

Upload sample data

NOTE
If you haven’t already, be sure to download the Sample Files
  1. In the Source data schema section of the screen, upload the JSON file Lab_Single_Customer_sample.json from your local file system you downloaded from the previous lab.
  2. Once the file is uploaded, a preview appears as follows. Click the Next button in the upper right to continue. Observe how the birth_Date field is in a different format YYYY-MM-DD compared to the MM/DD/YYYY format that you saw in the batch ingestion lab earlier.

Preview of the uploaded LabSingleCustomersample.json record for pipeline design and validation

NOTE
The JSON sample file contains a single record for designing and validating the pipeline. If you want to scroll, you have to click on the XDM nodes to cause the nodes to scroll.

Configure dataflow detail

In this screen, you are creating a specific dataflow that leverages the HTTP API account you set up. You can have many dataflows per account. In this scenario, you need to create a dataflow for streaming customer account data. A dataflow requires an association between a source account, a dataset with associated schema, and configuration details.

Perform the following steps:

  1. Create a New dataset and name it as -> Customer Account Stream - <Your Initials>
  2. Choose the Schema as ->dep: Customer Account
  3. Ensure the Profile dataset toggle is enabled. If not enable it.
  4. Update the Dataflow name like so:
    • Customer Account Stream - <Your Initials>
  5. Click the Next button to continue

Configuring the dataflow detail for the Customer Account streaming dataset

NOTE
If you do not enable the dataset for Profile then data streams into the Data Lake only. You don’t see your streaming events in the Profile or the Identity Graph.
recommendation-more-help
blueprints-learn-help-blueprints