Smart Tags for AEM Assets using-smart-tags
Organizations possess numerous digital assets, and this number continues to grow rapidly. Searching for a specific asset amidst such a vast amount of data poses a significant challenge. To address this, metadata and tags are employed to enhance the searchability of digital assets. Organizations use taxonomy-controlled vocabularies in asset metadata. These typically consist of keyword lists that employees, partners, and customers commonly use to refer to and locate digital assets.
Smart Tags are keywords that not only appear in the text but also best describe the asset. Tagging assets with taxonomy-controlled vocabulary ensures they can be easily identified and retrieved through search.
For instance, words arranged alphabetically in a dictionary are easier to find than randomly scattered ones. Tagging serves a similar purpose. It organizes assets according to business taxonomy, ensuring that the most relevant ones appear in search results. For example, a car manufacturer can tag car images with model names, so that only relevant images are displayed when designing a promotional campaign. Whether tagging “runners” or “running shoes,” users do not need to worry about typos, spelling variations, or alternate search terms—Smart Tags recognize them all.
In the background, the functionality uses the artificially intelligent framework of Adobe Sensei automatically applies Smart Tags to uploaded assets—by default—along with text aligned to the business taxonomy.
Prerequisites and configuration smart-tags-prereqs-config
Smart Tags is automatically provisioned for Adobe Experience Manager as a Cloud Service and hence no configuration is required.
Smart Tags workflow smart-tags-workflow
Adobe Sensei powered smart tagging uses artificial intelligence models to analyze content and add tags to the assets. Thereby-reducing time for DAM users to deliver rich experiences to their customers. The Smart Tags are displayed in descending order of their confidence score in asset properties.
-
Image-based assets
For images, the Smart Tags are based on some visual aspect. Images in many formats are tagged using smart content services. Smart Tags are applied to the supported file types that generate renditions in JPG and PNG format. -
Video-based assets
For video-based assets, tagging is enabled by default in Adobe Experience Manager as a Cloud Service. Likewise Image and text based tags, videos are also auto-tagged when you upload new videos or reprocess existing ones. Adobe Sensei generates two sets of tags for a video: One set corresponds to objects, scenes, and attributes in that video, whereas, the other set relates to actions such as drinking, running, and jogging. Also check opt out video smart tagging. -
Text-based assets
For supported assets, Experience Manager already extracts the text, which is then indexed and is used to search for the assets. However, Smart Tags based on keywords in the text provide a dedicated, structured, and higher priority search facet. The latter helps improve asset discovery as compared to a search index.
For text-based assets, the efficacy of Smart Tags does not depend on the amount of text in the asset but on the relevant keywords or entities present in the text of the asset.
Smart Tags are implemented in AEM Assets using the following workflow:
-
Create or upload an asset in AEM. Out of the box tags are generated for image, video, and text based Assets.
-
If you find that specific tags are not generated, then you can train your image-type tags accordingly. Refer to Smart Tags training.
Supported file formats for Smart Tags supported-file-formats
Preparing an asset for out of the box smart tagging
When you upload assets to Adobe Experience Manager as a Cloud Service, the uploaded assets are processed. Once the processing is complete, see the Basic tab of asset Properties page. Smart Tags are automatically added to the assets under Smart Tags. Asset microservices uses Adobe Sensei to create these Smart Tags.
Untagged Assets in DAM smart-tag-existing-assets
The existing or older assets in DAM are not smart tagged automatically. You need to Reprocess Assets manually to generate Smart Tags for them. Once the process completes, navigate to the Properties page of any asset within the folder. The automatically added tags are seen in Smart Tags section in Basic tab. These applied Smart Tags are sorted in descending order of confidence score.
Confidence Score confidence-score
Your asset search results are ranked based on the confidence scores, which generally improve search results beyond what an inspection of the assigned tags of any asset suggests. Inaccurate tags often have low confidence scores so they seldom appear at the top of the Smart Tags list for assets.
Moderate Smart tags moderate-smart-tags
Adobe Experience Manager as a Cloud Service allows you to curate the Smart Tags to:
-
remove inaccurate tags assigned to your brand assets.
-
refine tag-based searches for assets by ensuring that your asset appears in search results for the most relevant tags. It, therefore, eliminates the chances of unrelated assets from showing up in search results.
-
assign a higher rank to a tag to increase its relevance with respect to an asset. Promoting a tag for an asset increases the chances of the particular asset appearing in search results when a search is performed based on that tag.
To know more about how to moderate the Smart Tags for assets, see Manage Smart Tags.
Manage Smart Tags and asset searches manage-smart-tags-and-searches
You can curate Smart Tags to remove any inaccurate tags that may have been assigned to your brand assets, so that only the most relevant tags are displayed.
Moderating Smart Tags also helps refine tag-based searches for assets by ensuring that your assets appear in search results for the most relevant tags. Essentially, it helps eliminate the chances of unrelated assets from showing up in search results.
You can also assign a higher rank to a tag to increase the tag’s relevance for the asset. Promoting a tag for an asset increases the chances of the asset appearing in search results when a search is performed based on the particular tag.
To moderate the Smart Tags of your digital assets:
-
In the search field, search for digital assets based on a tag.
-
To identify the digital assets that you do not find relevant to your search, inspect the search results.
-
Select an asset, and then select
-
From the Manage Tags page, inspect the tags. If you do not want the asset to be searched based on a specific tag, then select the tag and select
-
To assign a higher rank to a tag, select the tag and select
-
Select Save and then select OK to close the Success dialog.
-
Navigate to the Properties page for the asset. Observe that the tag that you promoted is assigned a high relevance and, therefore, appears higher in the search results.
Understand Experience Manager search results with Smart Tags understand-search
By default, Experience Manager combines the search terms with an AND or OR clause to find any of the search terms in the applied Smart Tags. Using Smart Tags does not change this default behavior. For example, consider searching for woman running. Assets with just woman or just running keyword in the metadata do not appear in the search results by default. However, an asset tagged with either woman or running using Smart Tags appears in such a search query. So the search results are a combination of,
-
Assets with
womanandrunningkeywords in the metadata. -
Assets smart tagged with either of the keywords.
The search results that match all search terms in metadata fields are displayed first, followed by the search results that match any of the search terms in the Smart Tags. In the above example, the approximate order of display of search results is:
- matches of
woman runningin the various metadata fields. - matches of
woman runningin Smart Tags. - matches of
womanor ofrunningin Smart Tags.
Opt out of smart tagging opt-out-smart-tagging
As the automated tagging of assets runs in parallel to other asset processing tasks like thumbnail creation and metadata extraction, it can be time consuming. To expedite the asset processing, you can opt out of smart tagging on upload at folder level. To opt out of automated Smart Tags generation for assets uploaded to specific folder:
-
Open Asset Processing tab in folder Properties.
-
In Smart Tags for Videos menu, for example, Inherited option is selected by default and video smart tag is enabled.
When the Inherited option is selected, the inherited folder path is also visible along with the information whether it is set to Enable or Disable.
-
Select Disable to opt out of smart tagging uploaded to the folder.
-
Similarly, you can opt out smart tagging for Smart Tags for Text, Smart Tags for Image, and Color Tags for Images.
Limitations and best practices related to Smart Tags limitations-best-practices-smart-tags
These models are not always perfect at identifying tags. The current version of the Smart Tags has the following limitations:
-
Inability to recognize subtle differences in images. For example, slim-fit versus regular-fit shirts.
-
Inability to identify tags based on tiny patterns or parts of an image. For example, logos on shirts.
-
The tags that are not handled relate to:
- Non-visual, abstract aspects. For example, the year or season of release of a product, mood or emotion evoked by an image, and a subjective connotation of a video.
- Fine visual differences in products such as shirts with and without collars or small product logos embedded on products.
-
Only the videos smaller than 300 MB in file size are auto-tagged. The Adobe Sensei service skips video files that are larger in size.
-
To search for files with Smart Tags (regular or enhanced), use the Assets search (full-text search). There is no separate search predicate for Smart Tags.
-
In comparison of general tags, the assets that are tagged using business taxonomy are easier to identify and retrieve by tag-based searches.