Adobe Firefly Audio and Video modules

In an Adobe Workfront Fusion scenario, you can automate workflows that use Adobe Firefly Audio and Video, as well as connect it to multiple third-party applications and services.

If you need instructions on creating a scenario, see the articles under Create a scenario: article index.

For information about modules, see the articles under Modules: article index.

Access requirements

Expand to view access requirements for the functionality in this article.
table 0-row-2 1-row-2 2-row-2 3-row-2 layout-auto html-authored no-header
Adobe Workfront package

Any Adobe Workfront Workflow package and any Adobe Workfront Automation and Integration package

Workfront Ultimate

Workfront Prime and Select packages, with an additional purchase of Workfront Fusion.

Adobe Workfront licenses

Standard

Work or higher

Adobe Workfront Fusion license

Operation-based: No Workfront Fusion license requirement

Connector-based (legacy): Workfront Fusion for Work Automation and Integration

Product If your organization has a Select or Prime Workfront package that does not include Workfront Automation and Integration, your organization must purchase Adobe Workfront Fusion.

For more detail about the information in this table, see Access requirements in documentation.

For information on Adobe Workfront Fusion licenses, see Adobe Workfront Fusion licenses.

Prerequisites

Before you can use the Adobe Firefly Audio and Video connector, you must ensure that the following prerequisites are met:

  • You must have an active Adobe Firefly Audio and Video account.

Create a connection to Adobe Firefly Audio and Video

To create a connection for your Adobe Firefly Audio and Video modules:

  1. In any module, click Add next to the Connection box.

  2. Fill in the following fields:

    table 0-row-2 1-row-2 2-row-2 3-row-2 4-row-2 layout-auto html-authored no-header
    Connection name Enter a name for this connection.
    Environment Select whether you are connecting to a production or non-production environment.
    Type Select whether you are connecting to a service account or a personal account.
    Client ID Enter your Adobe Client ID. This can be found in the Credentials details section of the Adobe Developer Console.
    Client Secret Enter your Adobe Client Secret. This can be found in the Credentials details section of the Adobe Developer Console.
  3. Click Continue to save the connection and return to the module.

Adobe Firefly Audio and Video modules and their fields

When you configure Adobe Firefly Audio and Video modules, Workfront Fusion displays the fields listed below. Along with these, additional Adobe Firefly Audio and Video fields might display, depending on factors such as your access level in the app or service. A bolded title in a module indicates a required field.

If you see the map button above a field or function, you can use it to set variables and functions for that field. For more information, see Map information from one module to another.

Map toggle

Actions

Describe template

This action module analyzes a MOGRT (video template) file and return a manifest of editable controls, fonts, images, audio, video, and other supported values.

Connection
For instructions on creating a connection to Adobe Firefly, see Create a connection to Adobe Firefly in this article.
URL
Enter or map the presigned URL that points to the input template file.

Dub audio or video

This action module generates dubbed audio or video. It can also include lip sync in the generated video.

Connection
For instructions on creating a connection to Adobe Firefly, see Create a connection to Adobe Firefly in this article.
Dub type
Select whether you want to generate an audio or video dub.
Presigned URL

Enter or map the presigned URL that the module will use for input.

The following domains for media storage are accepted by Firefly Audio and Video

  • adobe.io
  • frame.io
  • amazonaws.com
  • windows.net
  • dropboxusercontent.com
  • drive.google.com
  • cloudfront.net
Media type
Select the media type of the input file
Lip sync
Select whether to generate a high-quality composited lip sync for the video output.
Target locale codes
For each locale code you want to add, click Add item and select the locale code.
Transcripts
For each transcript you want to add, click Add item and enter or map the presigned URLs for the transcript.

Generate avatar video from text or audio

This action module generates an avatar video from a transcript or audio file you provide.

Connection
For instructions on creating a connection to Adobe Firefly, see Create a connection to Adobe Firefly in this article.
URL
Enter or map the presigned URL that the module will use for input.
Locale code
Select the locale code that represents the language you want to use in the result.
Media type (Source)
Select the media type of the input file
Avatar
Select the avatar that you want to use for the generated video.
Media type
Select the output media type for the generated video.
Width
Enter or map the width for the generated video.
Height
Enter or map the height for the generated video.
Background

Select the type of background that you want to use for the generated video:

  • Video: Enter or map the URL of the background video.
  • Image: Enter or map the URL of the background image.
  • Color: Enter or map the hex value of the color you want to use for the video background.

Generate speech from text

This action module generates speech from a transcript. You can provide either a plain text transcript or a presigned URL. The response includes a job ID and a status URL for tracking the job.

Connection
For instructions on creating a connection to Adobe Firefly, see Create a connection to Adobe Firefly in this article.
Script

Select the type of script that you want to provide.

  • Text: Enter or map the source text into the Text field.
  • Text file: Enter or map the URL of the text file in the URL field.
Locale code
Select the locale code that represents the language you want to use in the result.
Media type
This should be text/plain.
Voice
Select the voice that you want to use. Available voices are from the Adobe Firefly catalog of voices.
Output
This should be audio/wav.

Reframe video

This module reframes the media you provide. Media is provided via a presigned URL.

Connection
For instructions on creating a connection to Adobe Firefly, see Create a connection to Adobe Firefly in this article.
Presigned URL

Enter or map the presigned URL that the module will use for input.

The following domains for media storage are accepted by Firefly Audio and Video

  • adobe.io
  • frame.io
  • amazonaws.com
  • windows.net
  • dropboxusercontent.com
  • drive.google.com
  • cloudfront.net
Scene edit detection
Select whether to apply scene edit detection before reframing.
Focal point
For each focal point you want to add, click Add item and enter or the keyword identifier for the focal point.
Overlays

For each overlay you want to add, click Add item and enter the overlay information.

  • Source: Enter or map the URL that points to the source media.
  • Start time: Enter or map the start time.
  • Duration: Enter or map the duration of the overlay.
  • Width: Enter or map the width of the scaled overlay.
  • Height: Enter or map the height of the scaled overlay.
  • Anchor point: Select the anchor point for the overlay.
  • Offset X: Enter or map the horizontal offset for the overlay.
  • Offset Y: Enter or map the vertical offset for the overlay.
  • Repeat: Enter loop to cause a GIF to loop.
Media format
Select the format for the reframed video.
Sidecar format
Select the format for additional metadata.
Renditions
To add additional renditions, click Add item and enter the rendition information.

Render template

This module renders one or more video variations by applying overrides and export presets.

Connection
For instructions on creating a connection to Adobe Firefly, see Create a connection to Adobe Firefly in this article.
Input template file URL
Enter or map the presigned URL that represents the template that you want to render.
Fonts
For each font that you want to add, click Add item and enter the postscript name of the font and the font file URL.
When a font is missing
Select whether you want to fail the render or use the default font if a font is missing.
Media assets
For each media asset that you want to add, click Add item and enter or map the presigned URL that represents the asset.
Export presets
For each export preset that you want to add, click Add item and select the video preset, and enter or map the presigned URL that represents the preset.
Variations
For each variation that you want to add, click Add item and enter details for the variation. You must enter details for at least one variation.
Output definitions
Define outputs by clicking Add item and selecting which of the added variations and presets you want to use, and adding a filename. Variations and presets are indexed to 0 (the first item in the list of variations is 0, the next is 1, and so on).

Transcribe media

This module transcribes audio or video.

Connection
For instructions on creating a connection to Adobe Firefly, see Create a connection to Adobe Firefly in this article.
Transcription type
Select whether you want to transcribe audio or video.
Presigned URL
Enter or map the presigned URL that the module will use for input.
Media type
Select the media type of the input file
Target locale codes
For each locale code that you want to add, click Add item and select the locale code that represents the language you want to use in the result.
Caption format
Enter SRT to include captions, or leave blank if you do not want captions.
recommendation-more-help
workfront-fusion-help-workfront-fusion