Bulk import assets using Assets view

Bulk Import in AEM Assets view provides administrators with the ability to import large number of assets from a data source to AEM Assets. The administrators do not need to upload individual assets or folders to AEM Assets anymore.

NOTE

The Assets view bulk importer uses the same backend as that of the Admin view bulk importer. However, it offers more data sources to import from and a more streamlined user experience.

You can import assets from the following data sources:

  • Azure
  • AWS
  • Google Cloud
  • Dropbox

Prerequisites

Data Source Prerequisites
Azure
  • Azure Storage Account
  • Azure Blob Container
  • Azure Access Key or SAS Token based on the authentication mode
AWS
  • AWS Region
  • AWS Bucket
  • AWS Access Key
  • AWS Access Secret
Google Cloud
  • GCP Bucket
  • GCP Service Account Email
  • GCP Service Account Private Key
Dropbox
  • Dropbox Client ID
  • Dropbox Client Secret

In addition to these prerequisites based on the data source, you must be aware of the source folder name available in your data source that contains all assets that need to be imported to AEM Assets.

Create bulk import configuration

Execute the following steps to create a bulk import configuration:

  1. Navigate to Settings > Bulk Import and click Create Import.

  2. Select the data source. The available options include Azure, AWS, Google Cloud, and Dropbox.

  3. Specify a name for the bulk import configuration in the Name field.

  4. Specify the data source specific credentials, as mentioned in Prerequisites.

  5. Provide the name of the root folder that contains assets in the data source in the Source Folder field.

  6. (Optional) Select the Delete source file after import option to delete the original files from the source data store after the files are imported into Experience Manager Assets.

  7. Select the Import Mode. Select Skip, Replace, or Create Version. Skip mode is the default and in this mode, the ingestor skips to import an asset if it exists already.
    Import source details

  8. (Optional) Specify the metadata file to import, provided in CSV format, in the Metadata File field and click Next to navigate to Location & Filters.

  9. To define a location in DAM where assets are to be imported using the Assets Target Folder field, specify a path. For example, /content/dam/imported_assets.

  10. (Optional) In the Choose Filters section, provide the minimum file size of assets in MB to include them in the ingestion process in the Filter by Min Size field.

  11. (Optional) Provide the maximum file size of assets in MB to include them in the ingestion process in the Filter by Max Size field.

  12. (Optional) Select the MIME types to include in the ingestion process using the Include MIME Type field. You can select multiple MIME types within this field. If you do not define a value, all MIME types are included in the ingestion process.

  13. (Optional) Select the MIME types to exclude in the ingestion process using the Exclude MIME Type field. You can select multiple MIME types within this field. If you do not define a value, all MIME types are included in the ingestion process.

    Bulk import filters

  14. Click Next. Select Save & run import to save the configuration and run the bulk import. Select Save import to save the configuration for now so that you can run it later.

    Execute bulk import

  15. Click Save to execute the selected option.

Handling filenames during bulk import

When you import assets or folders in bulk, Experience Manager Assets imports the whole structure of what exists in the import source. Experience Manager follows the inbuilt rules for special characters in the asset and folder names, therefore these filenames need sanitization. For both folder name and asset name, the title defined by the user remains unchanged and is stored in jcr:title.

During bulk import, Experience Manager look for the existing folders to avoid reimporting the assets and folders, and also verifies the sanitization rules applied in the parent folder where the import takes place. If the sanitization rules are applied in the parent folder, the same rules are applied to the import source. For new import, the following sanitization rules are applied to manage the filenames of assets and folders.

For more information on disallowed names, handling asset names, and handling folder names during bulk import, see Handling filenames during bulk import in Admin view.

View existing bulk import configurations

If you select to save the configuration after creating it, the configuration displays in the Saved Imports tab.

Save bulk import configuration

If you select to save and run the import, the import configuration displays in the Executed Imports tab.

Save bulk import configuration

If you schedule an import, it displays in the Scheduled Imports tab.

Edit bulk import configuration

To edit the configuration details, click … corresponding to the configuration name and click Edit. You cannot edit the title of the configuration and the import data source while performing the edit operation. You can edit the configuration using Executed, Scheduled, or Saved Imports tabs.

Edit bulk import configuration

Schedule one-time or recurring imports

To schedule a one-time or a recurring bulk import, execute the following steps:

  1. click … corresponding to the configuration name available in the Executed Imports or Saved Imports tab and click Schedule. You can also reschedule an existing scheduled import by navigating to Scheduled Imports tab and clicking Schedule.

  2. Set a one-time ingestion or schedule an hourly, a daily, or a weekly schedule. Click Submit.

    Schedule bulk import configuration

Perform an import health check

To validate the connection to the data source, click … corresponding to the configuration name, and then click Check. If the connection is successful, Experience Manager Assets displays the following message:

Bulk import health check

Perform a dry run before executing an import

Click … corresponding to the configuration name and click Dry Run to invoke a test run for the Bulk Import job. Experience Manager Assets displays the following details about the Bulk Import job:

Bulk import health check

Run a bulk import

If you have saved the import while creating the configuration, you can navigate to Saved Imports tab, click … corresponding to the configuration and click Run.

Similarly, if you need to execute an already executed import, navigate to Executed Imports tab, click … corresponding to the configuration name and click Run.

Stop or schedule an ongoing import

You can schedule or stop an ongoing bulk import using the bulk import status dialog that displays on the Bulk Import home page during an import.

Ongoing import

You can also view the assets that have been imported in the target folder by clicking View Assets.

Delete a bulk import configuration

Click … corresponding to the configuration name existing in Executed Imports, Scheduled Imports, or Saved Imports tabs and click Delete to delete the Bulk Import configuration.

Navigate to assets after performing bulk import

To view the Assets target location where the assets are imported after running the Bulk Import job, click … corresponding to the configuration name, and then click View Assets.

On this page