Information about the Automated Segments report, one of the two specialized reports available to users of Automated Personalization (AP) and Auto-Target (AT) activities.
Consider the following when using Personalization Insights reports:
AP and AT activities are available as part of the Target Premium solution. They are not included with Target Standard without a Target Premium license.
Personalization Insights reports are available only for AP and AT activities that use a conversion optimization goal. Activities where the optimization goal was changed to conversion from revenue after the activity was already live are also not supported.
Personalization Insights reports are available only if the Primary Goal is selected from the Report Metric drop-down list.
Personalization Insights reports are supported in the default environment only.
Personalization Insights reports are generated only for activities that are in the Live status and have been activated and receiving traffic for at least 15 days.
Different visitors respond differently to the offers/experiences in your AP/AT activity. This report shows how different automated segments defined by Target’s personalization models responded to the offers/experiences in the activity.
If you have many activities, you can filter the list by selecting options from the Type, Status, Property, Reporting Source, Experience Composer, Metrics Type, and Activity Source drop-down lists.
The Automated Personalization Summary or Auto-Target Summary report displays, which provides information about the performance of your activities, represented by the first screen icon. The two additional icons represent the two Personalization Insights reports: Automated Segments and Important Attributes. Auto-Target has an extra graph icon for the graphical view of the Summary report.
The Automated Segments report won’t be available until at least 15 days after you’ve activated your activity. During this initial period, you won’t be able to access this report or click the Automated Segments icon. After 15 days have passed, assuming there is sufficient personalized traffic in your activity, the Automated Segments report will be available.
After 15 days from activating the activity, you can click the Automated Segments icon.
Select the desired date range.
Unlike the Summary report (performance reporting), Personalization Insights, including Automated Segments, is available only for fixed date ranges: 15 days, 30 days, and 60 days. These fixed date ranges allow Personalization Insights to use a large enough range of data to reduce the likelihood that you derive insights from a short-lived pattern in your activity. The two decisions you can make for your date range is the “End Date” and the “Duration.” You’ll notice that the “Start” is grayed out. The start date automatically changes based on your selections for the end date and duration.
You can access the available fixed date ranges from the Choose Duration drop-down list.
Review the Automated Segments report data.
(Optional) Download the report in CSV format for analysis in Excel and other tools.
The Personalization Insights UI report contains select information. The CSV download for the Automated Segments report contains additional details. The Automated Segments report download includes additional Automated Segments beyond the top segments included in the UI, along with how those segments performed against your offers or experiences.
The following table explains how to interpret the report and describes its elements:
|Left-hand side panel||The left-hand side panel lists the 20 largest “automated segments” identified by Target’s personalization models for this activity. An “automated segment” is like an audience, but it is defined by Target’s personalization models instead of by the marketer. Each automated segment is made up of specific values (or value ranges) of specific attributes.
Automated segments can overlap. Automated segments can be defined by one, two, three, or four attributes. See the examples below for more details.
To learn more about Target’s personalization models, see Random Forest Algorithm. To learn more about the attributes Target’s personalization models use to create the automated segments, see Data Collection for Target’s Personalization Algorithms.
|Center graph||The center graphs display how your activity’s content performed for the highlighted automated segment. As you click different segments on the left-hand panel, the center graphs update.|
|Pie charts||The pie charts at the top of the center panel show the size of the automated segment, as well as the total number of personalized visits in the activity (for example, traffic to this activity that was served by the personalization model. It does not include control traffic or traffic served by the overall winner model). The size of the segment is based only on personalized visits.
|Dual-axis bar chart||The dual-axis bar chart includes visit and conversion information by the offer or experience for that specific automated segment.|
|Pink bar||The pink bar represents the conversion rate, and uses the bottom axis of the graph. You can hover over the bar for more information|
|Blue bar||The blue bar represents the number of visits, and uses the top axis of the graph. You can hover over the bar for more information.|
|Grey dotted line||The grey dotted line represents the conversion rate for all personalized visits in the activity, across all offers/ experiences and automated segments.|
Automated Segment Example 1
This automated segment is defined based on only one attribute. Visitors included in this automated segment saw this AP activity on a weekday outside of typical working hours or on a weekend.
Automated Segment Example 2
This automated segment is defined based on two attributes. Visitors included in this automated segment who saw this AP activity had fewer than three page views in their current visit and were geographically based within the Latitude 42.57 and 47.29 (approximately between New Hampshire/Oregon and Washington/Maine for a US-based company).
Personalization Insights reports are not available yet for my activity. Why is that?
There are several reasons why the Personalization Insights reports are not yet available for your activity:
What is an attribute?
An attribute is information about a visitor or his or her specific visit used by the personalization algorithms to learn how to personalize traffic. For example, an attribute might be browser type, location, time of day of visit, and so forth.
For more information about what attributes Target uses in its personalization models, see Data Collection for Target’s Personalization Algorithms. For more information about how to upload new attributes into Target to use in Target’s personalization models, see Methods to get Data into Target.
What is an automated segment?
An “automated segment” is like an audience, but it is defined by Target’s personalization models instead of by the marketer.
An automated segment is made up of specific values (or value ranges) of specific attributes. See Step 5 above for example automated segments. Segments can overlap.
To learn more about the random forest personalization algorithm, which is the basis for Target’s personalization models, see Random Forest Algorithm.
**What decides the order of the automated segments? **
A score is computed for each segment, based on its size and how differently it performed to the content in your activity. The combination of these inputs determines the order of the automated segments such that larger segments with larger differences in how they responded to the different content will appear closer to the top of the segment list.
Why are only some of my offers / experiences showing up in the Automated Segments report?
AP and AT activities build one model per offer (in the case of AP) and one model per experience (in the case of AT). These activities start serving personalized traffic and create your Personalization Insights with as little as two models built. If you don’t see all of your offers / experiences in Personalization Insights, it is likely you don’t have models built for those specific offers/ experiences. You can check your activity’s Summary report and see if there is a clock icon beside that offer / experience. This icon indicates that models aren’t built yet for that offer / experience.
Why are some offers / experiences with a lower conversion rate receiving a larger amount of traffic compared to other offers / experiences for a certain automated segment?
There are several potential reasons why you might see more visits to a lower-conversion offer or experience within an automated segment, including:
Is the information in the Automated Segments and Important Attributes reports the same as in the CSV download?
No, the UI report contains select information. The CSV download contains additional details. The Automated Segment Insights report download includes additional Automated Segments beyond the top segments included in the UI, along with how those segments performed against your offers or experiences. The Important Attributes report includes the top 100 visitor attributes and their relative importance, while the UI only includes the top 10 visitor attributes.
Can I see Personalization Insights for a custom date range?
Personalization Insights reporting (both Automated Segments and Important Attributes) is available only for fixed date ranges: 15 days, 30 days, and 60 days. These fixed date ranges allow Personalization Insights to use a large enough range of data to reduce the likelihood that you derive insights from a short-lived pattern in your activity. You can select these durations for any end-date (where these is enough data in the activity to satisfy the duration).
How is Personalization Insights created?
Personalization Insights is created using an Adobe patent-pending technique called MAGIX (Model Agnostic Globally Interpretable Explanations). You can learn more about MAGIX in the Adobe research team’s published paper on the arXiv.org website.
Why does the total visitor traffic data in the Automated Segments report not match my AP or AT Summary/Performance report?
The Personalization Insights reports include only visitors who saw a piece of content selected by Target’s personalization models (i.e. it does not consider control traffic or traffic that is served by the overall winner model). This traffic type is called “personalized” traffic. The summary performance report in AP/AT includes control versus “targeted” traffic. Targeted traffic includes personalized traffic, as well as traffic that was served using the overall winner model and some randomly served traffic used to continue to learn.
Are the automated segments mutually exclusive?
No, there is overlap between the automated segments.
Is Personalization Insights available for revenue-based modeling goals/primary goal?
At this time, Personalization Insights is available only for conversion optimization goal activities. Adobe will be adding support for revenue optimization goal activities in a future release.
What are different ways I can leverage the information in Personalization Insights?
Is there any logic to the order that attributes appear in a segment card?
No, the order of the cards is based only on a ranking described above. The order of the attributes within a card isn’t based on any logic.