Guidelines and Best Practices for using Content Transfer Tool

Guidelines and Best Practices

Follow the section below to understand guidelines and best practices to use the Content Transfer Tool:

  • It is advisable to run Revision Cleanup and data store consistency checks on the source repository to identify potential problems and reduce the size of the repository.

  • If the AEM Cloud Author Content Delivery Network (CDN) config is configured to have a whitelist of IPs then it should be ensured that the source environment IPs are also added to the allowlist so that the source environment and AEM Cloud environment can communicate with each other.

  • In the ingestion phase, it is recommended to run the ingestion using the wipe mode enabled where the existing repository (author or publish) in the target AEM Cloud Service environment will be completely deleted and then updated with the migration set data. This mode is much faster than the non-wipe mode, where the migration set is applied on top of the current content.

  • After the content transfer activity is completed, the correct project structure is required in the Cloud Service environment to ensure that the content renders successfully in the Cloud Service environment.

  • Before running the Content Transfer Tool, you must ensure that there is enough disk space in the crx-quickstart subdirectory of the source AEM instance. This is because the Content Transfer Tool creates a local copy of the repository that is later uploaded to the migration set.
    The general formula to calculate the require free disk space is as follows:
    data store size + node store size * 1.5

    • data store size: the Content Transfer Tool uses 64 GB, even if the actual data store is larger.
    • node store size: segment store directory size or the MongoDB database size.
      Hence, for a segment store size of 20GB, the required free disk space would be 94GB.
  • A migration set needs to be maintained throughout the content transfer activity to support content top-ups. Since a maximum of ten migration sets can be created and maintained at a time during the content transfer activity, it is recommended to break up the content repository accordingly to ensure that you do not run out of migration sets.

Important Considerations Before Using Content Transfer Tool

Follow the section below to understand the important considerations while running the Content Transfer tool:

  • The minimum system requirement for Content Transfer Tool is AEM 6.3 + and JAVA 8. If you are on a lower AEM version, you need to upgrade your content repository to AEM 6.5 to use the Content Transfer Tool.

  • Java must be configured on the AEM environment, so that the java command can be executed by the user who starts AEM.

  • It is recommended to uninstall older versions of the Content Transfer Tool when installing the version 1.3.0 because there was a major architectural change in the tool. With 1.3.0, you should also create new migration sets and re-run extraction and ingestion on the new migration sets.

  • The Content Transfer Tool can be used with the following types of Data Store: File Data Store, S3 Data Store, Shared S3 Data Store, and Azure Blob Store Data Store.

  • If you are using a Sandbox Environment, ensure that your environment is current and upgraded to the latest release. If you are using a Production Environment, it is automatically updated.

  • To use the Content Transfer Tool, you need to be an admin user on your source instance and belong to the local AEM administrators group in the Cloud Service instance you are transferring content to. Unprivileged users will not be able to retrieve the access token to use the Content Transfer Tool.

  • If the setting Wipe existing content on Cloud instance before ingestion option is enabled, it deletes the entire existing repository and creates a new repository to ingest content into. This means that it resets all settings including permissions on the target Cloud Service instance. This is also true for an admin user added to the administrators group. User must need to be re-added to the administrators group to retrieve the access token for CTT.

  • The access token can expire periodically either after a specific time period or after the Cloud Service environment has been upgraded. If access token has expired, you will not be able to connect to the Cloud Service instance and you need to retrieve the new access token. The status icon associated with an existing migration set will change to a red cloud and will display a message when you hover over it.

  • The Content Transfer Tool (CTT) does not perform any kind of content analysis before transferring content from the source instance to the target instance. For example, CTT does not differentiate between published and unpublished content while ingesting content into a Publish environment. Whatever content is specified in the migration set will be ingested into the chosen target instance. User has the ability to ingest a migration set into an Author instance or Publish instance or both. It is recommended that while moving content to a Production instance, CTT be installed on the source Author instance to move content to the target Author instance and similarly, install CTT on the source Publish instance to move content to the target Publish instance. Refer to Running the Content Transfer Tool on a Publish instance for more details.

  • The Users and Groups transferred by the Content Transfer Tool are only those that are required by the content to satisfy permissions. The Extraction process copies the entire /home into the migration set and the Ingestion process copies all users and groups referenced in the migrated content ACLs. To automatically map the existing users and groups to their IMS IDs, please refer to Using User Mapping Tool.

  • During the extraction phase, the Content Transfer Tool is executed on an active AEM source instance.

  • After completing the Extraction phase of the content transfer process and before starting the Ingestion Phase to ingest content into your AEM as a Cloud Service Stage or Production instances, you will need to log a support ticket to notify Adobe of your intention to run Ingestion so that Adobe can ensure that no interruptions occur during the Ingestion process. You will need to log the support ticket 1 week prior to your planned Ingestion date. Once, you’ve submitted the support ticket, the support team will provide guidance on next steps. You can log a support ticket with the following details:

    • Exact date and estimated time (with your time-zone) when you plan to start the Ingestion phase.
    • Environment type (Stage or Production) that you plan to ingest data into.
    • Program ID.
  • The Ingestion Phase for the author scales down the whole author deployment. This means that the author AEM will be unavailable during the whole ingestion process. Please also ensure that no Cloud Manager pipelines are executed while you are running the Ingestion phase.

  • When using Amazon S3 or Azure as the data store on the source AEM system, the data store should be configured so that the blobs stored cannot be deleted (garbage collected). This ensures integrity of index data and failure to configure this way may result in failed extractions due to lack of integrity of this index data.

  • If you are using custom indexes, you must ensure to configure the custom indexes with tika node before running Content Transfer Tool. Refer to Preparing the New Index Definition for more details.

  • If you intend to do top ups, it is essential that the content structure of existing content is not changed from the time the initial extraction is taken to when the top-up extraction is run. Top-ups cannot be run on content whose structure has been changed since the initial extraction. Please ensure you restrict this during the migration process.

  • If you intend to include versions as part of a migration set, and are performing top-ups with wipe=false, then you must disable version purging due to a current limitation in the Content Transfer Tool. If you prefer to keep version purge enabled and are performing top-ups into a migration set, then you must perform the ingestion as wipe=true.

What’s Next

Once you have learned the guidelines, best practices, and the important considerations for using Content Transfer Tool, you are now ready to install and use the tool, starting with creation of a migration set. See Getting Started with Content Transfer Tool to learn more.

On this page