Stream data to Experience Platform with Web SDK
Learn how to stream web data to Adobe Experience Platform with Platform Web SDK.
Experience Platform is the backbone of all new Experience Cloud applications, such as Adobe Real-Time Customer Data Platform, Adobe Customer Journey Analytics, and Adobe Journey Optimizer. These applications are designed to use Platform Web SDK as their optimal method of web data collection.
Experience Platform uses the same XDM schema you created earlier to capture event data from the Luma website. When that data is sent to Platform Edge Network, the datastream configuration can forward it to Experience Platform.
Learning objectives
At the end of this lesson, you will be able to:
- Create a dataset within Adobe Experience Platform
- Configure the datastream to send Web SDK data to Adobe Experience Platform
- Enable streaming web data for Real-Time Customer Profile
- Validate the data has landed both in the Platform dataset and in Real-Time Customer Profile
- Ingest sample loyalty program data into Platform
- Build a simple Platform audience
Prerequisites
To complete this lesson, you must first:
- Have access to an Adobe Experience Platform application like Real-Time Customer Data Platform, Journey Optimizer, or Customer Journey Analytics
- Complete the earlier lessons in the Initial Configuration and Tags Configuration sections of this tutorial.
Create a dataset
All data that is successfully ingested into Adobe Experience Platform is persisted within the data lake as datasets. A dataset is a storage and management construct for a collection of data, typically a table that contains a schema (columns) and fields (rows). Datasets also contain metadata that describes various aspects of the data they store.
Let’s set up a dataset for your Luma web event data:
-
Go to the Experience Platform or Journey Optimizer interface
-
Confirm you are in the development sandbox you are using for this tutorial
-
Open Data Management > Datasets from the left navigation
-
Select Create dataset
-
Select the Create dataset from schema option
-
Select the
Luma Web Event Dataschema created in the earlier lesson and then select Next
-
Provide a Name and optional Description for the dataset. For this exercise, use
Luma Web Event Data, then select Finish
A dataset is now configured to start collecting data from your Platform Web SDK implementation.
Configure the datastream
Now you can configure your datastream to send data to Adobe Experience Platform. The datastream is the link between your tag property, the Platform Edge Network, and the Experience Platform dataset.
-
Open the Data Collection interface
-
Select Datastreams from the left navigation
-
Open the datastream you created in the Configure a datastream lesson,
Luma Web SDK: Development Environment
-
Select Add Service
-
Select Adobe Experience Platform as the Service
-
Select Enabled
-
Select
Luma Web Event Dataas the Event Dataset -
Select Save
As you generate traffic on the Luma demo website mapped to your tag property, the data populates the dataset in Experience Platform!
Validate the dataset
This step is critical to make sure that the data has landed in the dataset. There are multiple ways to validate the path of data sent to the dataset.
- Validate using Experience Platform Debugger
- Validate using Experience Platform Assurance
- Validate using Preview Dataset
- Validate using Query Service
Debugger
These steps are more or less the same as what you did in the Debugger lesson. However, since data will only be sent to Platform after you have enabled it in the datastream, you must generate some more sample data:
-
Open the Luma demo website and select the Experience Platform Debugger extension icon
-
Configure the Debugger to map the tag property to your Development environment, as described in the Validate with Debugger lesson
-
Browse the website. View some products and add some to your shopping cart
-
In the Debugger, open the “events” row to look for some of your XDM variables
You have validated that data has left the browser and sent to the datastream!
Assurance
Since we have now enabled a service in the datastream, there is more we can see in Assurance:
-
Open your Assurance session or start a new one
-
Open the datastream event
-
Here you can view the configuration of the Platform service, including the id of the datastream you created earlier in this lesson.
-
Open the generic event belonging to the com.adobe.streaming.validation vendor. This shows that the request has been sent to the dataset with the accompanying XDM data
You have validated that the request was received by Platform Edge Network and forwarded to the Platform dataset.
Preview the dataset
Now, let’s actually look in the dataset! A quick option is to use the Preview dataset feature. Web SDK data is micro-batched to the data lake and refreshed in the Platform interface on a periodic basis. It might take 10-15 minutes to see the data that you generated.
-
In the Experience Platform interface, select Data Management > Datasets in the left-navigation to open the Datasets dashboard.
The dashboard lists all available datasets for your organization. Details are displayed for each listed dataset, including its name, the schema the dataset adheres to, and status of the most recent ingestion run.
-
Select your
Luma Web Event Datadataset to open its Dataset activity screen.
The activity screen includes a graph visualizing the rate of messages being consumed as well as a list of successful and failed batches.
-
Since this is a new dataset, if you see even one batch with records ingested, that is a positive sign:
-
From the Dataset activity screen, select Preview dataset near the top-right corner of your screen to preview up to 100 rows of data. If the dataset is empty, the preview link is deactivated.
-
A query will run to pull 100 recent rows of data from your dataset. You can drill into individual XDM fields, such as web.webPageDetails.name:
Query the data
You can run custom queries on the data as well to validate data ingestion:
-
In the Experience Platform interface, select Data Management > Queries in the left-navigation to open the Queries screen.
-
Select Create query
-
First, run a query to see all of the names of the tables in the data lake. Enter
SHOW TABLESin the query editor and click the play icon to rn the query. -
In the results, notice how the name of the table is
luma_web_event_data -
Now query the table with a simple query referencing your table (note that by default the query will be limited to 100 results):
SELECT * FROM "luma_web_event_data" -
After a few moments you should see sample records of your web data.
