Triggering data ingestion through APIs

Adobe Campaign Standard allows you to trigger the immediate ingestion of data mappings via APIs, and retrieve the status of your ingestion requests.

This page describes how to trigger and retrieve the ingestion status of your data mappings. For global information on Campaign Standard APIs, refer to this section.

Prerequisites

Before using the APIs, the data mapping must first have been configured and published within Campaign Standard interface. For more on this, refer to these sections:

• Mapping definition
• Mapping activation

Once the data mapping is created, you must stop it from running so that you can trigger it from the APIs whenever you want. To do this, follow these steps:

1. In Campaign Standard, go to the Administration > Development > Platform > Status of data export to platform menu.

2. Double-click the data mapping to open it, then click the Stop button.

   

3. Save your changes

The data mapping execution is now stopped. You can use Campaign Standard APIs to trigger it manually.

Starting the immediate ingestion of data mapping

Immediate ingestion of a XDM mapping into Adobe Experience Platform is triggered with a POST operation:

POST https://mc.adobe.io/<ORGANIZATION>/campaign/dataIngestion/xdmIngestion/<XDM Mapping ID>/ingest

var sqlRoleObj = REST.head.roleBase.sql.get();
REST.head.securityGroup.Administrators.roles.post(sqlRoleObj);

The POST operation returns information regarding the created request status:

• Request successfully submitted for the XDM Mapping:

{
"requestId": <value>,
"info": "Ingestion request submitted successfully for the Mapping ID: <value>",
"status":"Success"
}

• Request already in progress for the XDM Mapping:

{
"requestId": <value>,
"info": "Ingestion request already in progress for the Mapping ID: <value>",
"status":"In Progress"
}

• Request failed because the XDM mapping is not published or is stopped:

{
"info": "Unable to submit data ingestion request, XDM Mapping ID: <value> is not stopped",
"status": "Failed"
}
{
"info": "Unable to submit data ingestion request, XDM Mapping ID: <value> is not published",
"status": "Failed"
}

Retrieving the status of an ingestion request

The status of an ingestion request can be retrieved with a GET operation and the desired request ID in the parameters:

GET https://mc.adobe.io/<ORGANIZATION>/campaign/dataIngestion/xdmIngestion/<XDM Mapping ID>/ingest
{"requestId"="<value>"}

The GET operation returns the information below:

• batchId: this field is populated only if failure occurred after batch prepare and upload,
• info: the XDM mapping ID,
• numRecords: the number of records that have been ingested (success status only),
• status: the ingest request status (success/failed/in progress)

Possible responses to the GET operation are:

• Ingest request successful:

  {
  "batchId": "",
  "info": "Mapping Id: <value>. ",
  "numRecords": 15,
  "requestId": 3520,
  "status": "Success"
  }
  

• Ingest request failed with 0 record ingested:

  {
  "batchId": "",
  "info": "Mapping Id: <value>. ACP-880056 Failed to fetch the record from the database.",
  "numRecords": 0,
  "requestId": 3520,
  "status": "Failed"
  }
  

• Ingest request failed, with some record uploaded under a batch:

  {
  "batchId": "<value>",
  "info": "Mapping Id: <value>. ACP-880096 Sync Job failed to upload. Please check the error in the Platform UI.",
  "numRecords": 0,
  "requestId": <value>,
  "status": "Failed"
  }
  

• Ingest request aborted after ingesting some records (this may happen in crash scenarios):

  {
  "batchId": "",
  "info": "Mapping Id: <value>. Ingestion request aborted due to some issue with data ingestion service. Please submit a new request",
  "numRecords": 0,
  "requestId": <value>,
  "status": "Aborted"
  }
  

• Ingest request in progress (when request uploaded the data in a batch or when batch is getting prepared for the request):

  {
  "batchId": "",
  "info": "Mapping Id: <value>.",
  "numRecords": 0,
  "requestId": <value>,
  "status": "In Progress"
  }