AI Driven Content Discovery with Channel Ready Renditions

Transcript

Alright so this session we’re gonna be talking about AI driven content discovery with channel ready renditions and We have here so I’m from the assets team digital asset management We have these prizes these damn beavers that we’re gonna be looking for Whoever’s the most engaged while we present we’re gonna be handed these out afterwards So, my name is Matt. I’m gonna be presenting with Deepa for dynamic media and Matias for content fragments So When we talk about discovering content before even introducing AI we had a concept of a user manages assets by organizing them into folders and We have a micro front end called the asset selector So the asset selector is available in the modal form or the rail form and it allows you to go and select your assets But one of the major problems with the asset selector is that for the users that are not the ones Organizing or managing the files. It’s difficult to find the perfect asset for their use case That’s why we’ve started exploring with content advisor Powering this asset discovery process with AI Now we have recommendations that are going to be relevant to whatever application a user is working on Be that first party we have integrations with Express work front throughout the Adobe ecosystem And we also have third-party integration capabilities for content advisor When we say Gen AI there’s a lot of different components that went into building the content advisor The first is a powerful semantic search that takes natural language queries So you don’t have to know an exact metadata property or keyword? You can just describe what you’re looking for and we’re we’re gonna surface content that is relevant to that natural query We also now support a document brief as input. So if a user has a PDF From a marketing workflow or other content supply chain workflow They can drop that directly into search and it will perform a search and get relevant assets and content fragments related to that document Suggested Content is one of the most powerful new features that we’ve been added to content advisor and we’ve made it extremely developer friendly So whatever applications you’re using content advisor You can pass in context that will provide some ready-to-use recommendations out of the box I’m gonna show a really simple use case with a rich text editor that gets spot-on recommendations every time Dynamic media Deepa is gonna dive deep on dynamic media. So that’ll be super interesting and Matias is gonna go deep on content fragments and The full power of having a unified experience that brings both assets and content fragments to a single surface Not only do we have assets and content fragments But all of the saved data that you have in a EM or in the author environment is available now in content advisor So your saved searches filters and metadata will be readily available without any developer configuration required it all happens on the user level and Lastly in order to organize and manage this content. We have the full collection support including that semantic and rich search experience So now I’m going to dive right into this demo So Up here on the screen. I have a rich text editor that has a Blog post that I’ve been working on called the art of the morning coffee Without knowing exactly where the asset resides I can just click on this and it brings up content advisor and It’s pre populated with recommendations that are relevant to the content of the document that I’ve been working on I Can select this asset and it’s ready for use So as this content changes these recommendations update in real time and it almost feels instantaneous The speed of which we get those new recommendations So not only do people not need to know where these assets are, but they’re going to be available for consumption Immediately in both first and third party context like I mentioned If we change a property to the content advisor we can change it from a modal form factor over to a rail form factor the rail has the advantage that a user can simply drag and drop assets and Use those directly. This is how we integrate with Express but also third-party the micro front end has a callback It has some unique technology because this is within an iframe but we’re able to pass this information across the frame Going back to the modal. I want to show the power of semantic search where previously if you tried a query in a different language And it wasn’t matching the metadata or the properties that were in the given locale for the asset It wouldn’t be able to find any results I’m gonna perform this search in Spanish and Even though none of these assets are explicitly tagged in Spanish It’s relevant to the intent in whatever localized language I used to perform the search Over here. I have saved searches that are available from assets view So anything that I’ve worked on in the author environment is instantly available within content advisor Deepa is gonna show some of the cool power of dynamic media But inside of our new quick detail panel, we have a much richer experience Previously, we just had a popover the quick detail panel gives you a full mini viewer experience for assets and content fragments As well as the saved metadata forms that you’ve worked on Switching back over to the slide deck I want to show just how easy it is to enable these content advisor features whether you’re coming in fresh to the asset selector or Haven’t installed it yet Inside of asset selector we’ve added some new properties So there’s a feature set where if you pass advisor that instantly enables the recommendation section If you pass in content fragments, you have an additional tab where you have a unified surface that shows assets and content fragments the Recommendations are powered by a property that we call the external brief and this external brief can be any type of unstructured text Content simply describe what the user is working on and it will provide relevant recommendations based on that text So in the example, I just showed this variable content was simply the entire text output from the rich text editor no more developer work required than that and We also have the ability to choose whether you’re getting those saved filters from assets view From the author environment or you can configure those via a property Now Joe I’ll jump back for one second because I wanted to say if you’re interested in joining the content advisor beta Please take a picture of this QR code and you’ll be able to sign up your team and get early access to all of this goodness Lastly after you’ve selected and found the perfect content for your use case We have new open API’s that allow you to download both the originals of the asset as well as renditions But let’s say you’re working on something where you want an instantly available Web-ready rendition in a specific form factor and you don’t want to go through the whole process of Redesigning and going through creative again. Well, that’s where dynamic media comes in and Deepa’s gonna show us that That’s an amazing start Okay Good afternoon, everyone Let’s quickly talk about how you can unlock the benefits of dynamic media via content advisor in your downstream application You can now preview and select your dynamic your web optimized variations of main asset or this asset which you want to select into your downstream application with quite an ease With the power of dynamic media you get to deliver faster and scalable experiences as The dynamic media ability to deliver content at scale and speed You get to choose the perfect fit for your use case With the help of dynamic media You can now skip any format or size related limitation that the downstream application may be imposing while selecting an asset Let’s quickly realize this in two short demos Okay, so here a marketer wants to design a template or email for an upcoming Campaign this is an email designer application where he wants to pick an asset which matches For this particular header section. He goes on to the asset. He goes on to the content advisor and And Wants to pull an asset of his choice. I’ll just quickly hide this Let’s see the behavior when he tries to use this main asset. This is obviously not the desired Experience because the asset is the main subject is not on the focus now Let’s open the quick details panel and within the dynamic media tab the marketer can now preview the Smart crops which are available for this main assets. He can quickly drag and drop the most perfect fit for his use case coming on to the second demo here a creative wants to Change the background for this particular design why I express so he he just triggers the replace workflow via the am assets plugin and Tries to look for an asset via the content advisor Okay, let’s see Let’s try using this asset, but he can’t because the Express imposes a size limit of 80 megabytes While you know putting an asset on the canvas Again, let’s go into the dynamic media and try to bring the web optimized rendition for this asset see the huge benefit which you get in terms of the size without compromising on the limit Without compromising on the quality of the image Let’s quickly make this asset more suitable as a background by applying the image modifiers Which is a feature that dynamic media provides and he’s ready to go within no time just like We could skip the size limitation The dynamic media helps you skip any format related limitations as well coming back to the slides Okay Some of the key features that the dynamic media tab provides within the content advisor you get to preview and select your base dynamic media renditions and smart crops The tab is supported for supports both the stack the am dynamic media scene 7 and the dynamic media with open API stack you get the ability to generate on-the-fly variations within no time and It is it supports the standard image formats the design authoring formats and videos as well Some of the prerequisites which you require to use this tab in content advisor these are some of the actions which you require on the AMCS repository and it has to be either scene 7 or the dynamic media with open API enabled And your assets needs to be either published or approved from the repository Lastly you must create your image presets and smart crops to be able to preview and select them via the advisor panel Moving on to how you can enable dynamic media and content advisor. It’s a three-step process The first is to enable the tab by default This is a device available in the advisor If you are on asset selector, you can pass in these two the detail panel and dynamic media props within the feature set which matches so showed The key second step is to adjust your code to be able to generate dynamic media URL Using the new selected media sub-object, which we have introduced as part of the handle selection callback and Once your integration codes generate dynamic media URL, you can then go to consume them in the desired way Let’s quickly delve into what this Selected media sub-object is. So one of the key thing to understand here is that the content advisor will not hand over you a pre-built dynamic media URL instead. We want the application to build them just like they prepare for any other API call Instead what the advisor will hand over you is the selection which you have done from the panel So based on the dynamic media stack your AMCS repositories is configured with and the option which are available on the Panel, which is labeled as DM API style. The API style will get populated as either scene 7 or open API Among the base preset and smart crop only one will appear in the final object based on the selection done from the panel and modifier is an optional array, which Will get populated as a key value pair only if the user has added them while using the panel Okay, so for the AM DM scene 7 API style Where you want to choose a smart crop with smart crop choose a smart crop with modifiers your exported asset object will have information like your scene 7 file your scene 7 domain and the selected media object will have the Smart crop key the modifiers key and the API style as scene 7 Similarly for the dynamic media with open API URL if you you intend to build a URL for the DM with open API You get to choose the open API style from the panel along with any of the combination here I am just showing your smart crop and modify example Your asset object will have your repository ID Your selected media your asset ID now In the application code you you’ll have to code in order to build your dynamic media URL based on your API style This is because the scene 7 and the open API follow different URL format So you’ll have utility method which will be building your scene 7 URL as well as utility method for your DM open API URL So in your utility in in these methods You will then use the scene 7 file the scene 7 domain and the selected media object to build a URL Which conforms to the scene 7 style Moving on to the DM with open API URL From the exported asset object. You will make use of your selected media and the metadata To use properties like your repository ID your asset ID and the information from the selected media to build a DM open API conforming URL and Once you have done the selection your code generates the appropriate dynamic media URL you are now ready to use it in in the desired way, so be it could be an HTML image source tag or download For download purposes you can do a fetch call With this I’ll end my presentation and I will call up me to walk us through the Content fragments. Thank you everyone Thank You Deepa So one more thing at the end of the session here when they get back to as a mat had mentioned content fragments are supported In the content advisor as well, which is why a content advisors called content advisor and not just experience not image advisor and if we go back to Content advisor here. You see there’s a content fragments pill which Gives you a nice Overview of content fragments that are being surfaced by content advisor here The first thing to notice that these are new dynamic tiles that will update with any Content change that you make in the content fragment So anytime you change the image or you delete the image this will be reflected in this dynamic tile Same thing if you edit the text in a content fragment will be reflected here So it’s a very nice way to get a quick view into the content fragment right here in this tile view But then the question becomes how to actually view the content fragment itself And as you’ll know visualizing content fragments works only in two ways Typically either you load it in the editor, but then there is no a.m. Here. That’s content advisor plus in the editor It has the whole editor canvas around it with all the functions which night which might not be desirable For certain business users and the other alternative is to view content fragment as JSON Which can be very ugly for business users? so in order to Improve that we’ve added an entire new capability that I wanted to show Going into a.m. Actually first and I’m here in the Content fragment UI specifically in the content model tab and you see here in the lower right there is now the ability to Upload HTML templates to a.m. That can be used together with a content fragment to create a fully styled Rendering and visualization of a content fragment you can very easily upload a new template from your system Say here for example there are two templates In on the system and It creates a preview of this template and it shows you the HTML code of this template and the original Original origin the the origin of these templates in fact is code So these templates will have to be hand coded at the moment and we’re working on ways how to maybe automate this coming from Figma into a.m. So you create your HTML template and then importantly instrument the template with handlebar syntax That corresponds with the data type names in your content fragment Just your headline detail and call to action and those templates you then upload to a.m you can actually in this upload dialog still change the HTML and then Save and persist the template here in a.m. And I won’t do that because this template already exists to then When we go back to content advisor When we go back to content advisor and load the content fragments pill With the content fragments that we just saw and we go to Frescopa English Offers to this fragment here You see there is now in content advisor a nice preview capability in addition to a nice properties tab that we just added But a preview capability which brings up a model that creates a visualization of this content fragment firstly with a generic template that Exists in a.m And that can be used with any content fragment the user creates To always be able to create a preview in such a table format here to show the key value pairs So that users can also for example simply copy and paste content from content fragment here into their canvas But also to get us an overview of the content for a content QA for example before the content fragment is moved to subsequent groups in the process But then also to preview Content fragment with these custom templates these custom HTML templates that it can upload and it creates a preview like this And the nice thing is that if you have multiple templates in your system You can visualize what your content fragment will look like for a certain placement in a certain channel say this is email The other one is web or one is web and the other one is mobile You get a very nice visual impression of a content fragment in a very standard HTML rendering which is HTML with inline CSS that then can be used very easily outside of a.m. If you want to use this banner here, for example in another solution and Already talking with the AGO folks for example to be able to use banners like this year HTML fragments essentially like this in a geom And if you think this might look a little bit like experience fragment use cases in a.m That is exactly where this is going because we think this year is The future of experience fragments in a way that is not as tight to a.m As experience fragments are today with CQ templates and core components and client lips for the CSS very standard neutral HTML with inline CSS that can be used in in other places including of course a.m. Pages with a corresponding components or blocks So that’s content fragment templates. It isn’t beta currently. We’re in beta with one customer called Eli Lilly if You have a interest in Looking at this in more detail. Please reach out very happy to talk and Let me get back to the slides to also remind everyone where is the final slide This is here here at the very end To remind everyone of the content advisor beta in Context of which or as part of which you can also get access to this content fragment preview capability as well So take a picture of the screen of QR code and please reach out if you find this interesting. Thanks so much