Monitor dataflows for Profiles in the UI

Real-time Customer Profile lets you see a holistic view of each individual customer by combining data from multiple channels, including online, offline, CRM, and third party. Profile allows you to consolidate your customer data into a unified view offering an actionable, timestamped account of every customer interaction.

The monitoring dashboard provides you with a visual representation of the data’s activity within Profile, including the status of your data’s Profiles. This tutorial provides instructions on how you can use the monitoring dashboard to monitor your data’s profiles using the Experience Platform user interface, allowing you to track the status of Profile processing.

Getting started

This guide requires a working understanding of the following components of Adobe Experience Platform:

  • Dataflows: Dataflows are a representation of data jobs that move data across Platform. Dataflows are configured across different services, helping move data from source connectors to target datasets, to Identity and Profile, and to Destinations.
    • Dataflow runs: Dataflow runs are the recurring scheduled jobs based on the frequency configuration of selected dataflows.
  • Real-time Customer Profile: Provides a unified, real-time consumer profile based on aggregated data from multiple sources.
  • Sandboxes: Experience Platform provides virtual sandboxes which partition a single Platform instance into separate virtual environments to help develop and evolve digital experience applications.

Monitoring profiles dashboard

To access the Profiles dashboard, select Monitoring in the left navigation. Once on the Monitoring page, select the Profiles card.

The Profiles card. Information about the number of records received, the number of profile fragments created and updated, and the success rate is shown.

On the main Profiles dashboard, the Profiles card shows information about the total number of records received, the number of profile fragments created and updated, as well as the success rate of created and updated profile fragments.

The dashboard itself contains metrics about Profile processing. By default, the dashboard will show Profile processing details for your organization’s sources for the last 24 hours.

The Profiles dashboard. Information about the number of the Profile records received per source is displayed.

The Profile processing page contains information on records ingested to Profile, including number of profile fragments created, profile fragments updated, and the total number of profile fragments.

The following metrics are available for this dashboard view:

Metric Description
Source name The name of the source.
Records received The number of records received from data lake.
Records failed The number of records that were ingested, but not into Profile due to errors.
Profile fragments created The number of net new Profile fragments added.
Profile fragments updated The number of existing Profile fragments updated.
Total Profile fragments The total number of records written into Profile, including all existing Profile fragments updated and new Profile fragments created.
Total failed dataflows The number of dataflow runs that failed.

You can select the filter icon Filter icon beside the source name to see Profile processing information for that selected source’s dataflows.

The filter icon is highlighted. Selecting this icon allows you to view the selected source's dataflows.

Alternatively, you can select Dataflows on the toggle to see Profile processing details for your organization’s dataflows for the last 24 hours.

The Profiles dashboard. Information about the number of the Profile records received per dataflow is displayed.

The following metrics are available for this dashboard view:

Metric Description
Dataflow The name of the dataflow.
Dataset The name of the dataset that the dataflow is inserting to.
Source name The name of the source that the dataflow belongs to.
Records received The number of records received from data lake.
Records failed The number of records that were ingested, but not into Profile due to errors.
Profile fragments created The number of net new Profile fragments added.
Profile fragments updated The number of existing Profile fragments updated
Total Profile fragments The total number of records written into Profile, including all existing Profile fragments updated and new Profile fragments created.
Total failed flow runs The number of dataflow runs that failed.
Last active The timestamp which the dataflow was last run.

Select the filter icon filter beside the dataflow run start time to see more information on your Profile dataflow run.

The filter icon is highlighted. Selecting this icon allows you to view details about the selected dataflow.

The Dataflow run details page displays more information on your Profile dataflow run, including its organization ID and dataflow run ID. This page also displays the corresponding error code and error message provided by Profile, should any errors occur in the ingestion process.

A dashboard showing detailed information about the selected dataflow is displayed.

The following metrics are available for this dashboard view:

Metric Description
Records received The number of records received from data lake.
Records failed The number of records that were ingested, but not into Profile due to errors.
Profile fragments created The number of net new Profile fragments added.
Profile fragments updated The number of existing Profile fragments updated.
Status Defines the overall status of a dataflow. The possible status values are:
  • Success: Indicates that a dataflow is active and is ingesting data according to the schedule it was provided…
  • Failed: Indicates that the activation process of a dataflow has been disrupted due to errors.
  • Processing: Indicates that the dataflow is not yet active. This status is often encountered immediately after a new dataflow is created.
Dataflow run start The date and time the dataflow started to run.
Last updated The date and time the dataflow last updated.
Error summary If the dataflow run failed, this displays an error code and summary of why the dataflow run failed.
Dataflow run ID The ID of the dataflow run.
IMS org ID The organization ID that the dataflow run belongs to.

Additionally, you can select the toggle to view the records failed or the records skipped. The errors section includes details about the error code and number of records failed or excluded.

On this page