| Sources Flow Run Start | Sources Flow Run Start | This alert triggers when a source connection starts processing data. |
{
“id”: “66643b20-dc76-4b04-bacf-93bee162683c”,
“createdAt”: 1693339079768,
“updatedAt”: 1693339079768,
“createdBy”: “acme@AdobeID”,
“updatedBy”: “acme@AdobeID”,
“createdClient”: “acme_client”,
“updatedClient”: “acme_client”,
“sandboxId”: “1bd86660-c5da-11e9-93d4-6d5fc3a66a8e”,
“sandboxName”: “dev”,
“imsOrgId”: “5C1328435BF324E90A49402A@AdobeOrg”,
“flowId”: “dbc5c132-bc2a-4625-85c1-32bc2a262558”,
“providerRefId”: “M-05222685-e2b7-4367-a5a2-db4d7acda43d-incremental-0:2d304546-3817-42a6-b836-1a85fee51987”,
“etag”: “"0e0158eb-0000-0d00-0000-64ee4dc70000"”,
“metrics”: {
“statusSummary”: {
“status”: “inProgress”
}
},
“activities”: [],
“flowName”: “Sales plan- weekly_plan.csv”
“alertName”: “Sources Flow Run Start”
}
|
| Sources Flow Run Success | Sources Flow Run Success | This alert triggers when data is successfully ingested from a source connection. |
{
“id”: “e3b63e78-b9fb-4e58-bac6-b7497e7bde04”,
“createdAt”: 1694474662038,
“updatedAt”: 1694474985756,
“createdBy”: “acme@AdobeID”,
“updatedBy”: “acme@AdobeID”,
“createdClient”: “acme_client”,
“updatedClient”: “acme_client”,
“sandboxId”: “1bd86660-c5da-11e9-93d4-6d5fc3a66a8e”,
“sandboxName”: “mlb-enablement”,
“imsOrgId”: “5C1328435BF324E90A49402A@AdobeOrg”,
“flowId”: “dbc5c132-bc2a-4625-85c1-32bc2a262558”,
“providerRefId”: “M-cd9b4bbc-c1c6-4630-859e-49776afb483b-incremental-0:10f1f4bb-47cd-4093-a9af-95920cc11264”,
“etag”: “"760000d9-0000-0200-0000-64ffa2e90000"”,
“metrics”: {
“durationSummary”: {
“startedAtUTC”: 1694474649498,
“completedAtUTC”: 1694474676869
},
“sizeSummary”: {
“inputBytes”: 0
},
“recordSummary”: {
“inputRecordCount”: 0
},
“statusSummary”: {
“status”: “success”
}
},
“activities”: [{
“id”: “4f008a00-3a04-11eb-adc1-0242ac120002”,
“name”: “Maria DB Copy Activity”,
“updatedAtUTC”: 0,
“durationSummary”: {
“startedAtUTC”: 1694474649498,
“completedAtUTC”: 1694474676869
},
“latencySummary”: {},
“sizeSummary”: {
“inputBytes”: 0
},
“recordSummary”: {
“inputRecordCount”: 0
},
“fileSummary”: {},
“statusSummary”: {
“status”: “success”,
“extensions”: {}
}
}],
“flowName”: “Employee - Stolz Maria DB”
}
|
| Sources Flow Run Failure | Sources Flow Run Failure | This alert triggers when an error occurs while ingesting data from a source connection. |
{
“id”: “f0b809c5-603d-4d6e-9600-977cb2e277b4”,
“createdAt”: 1693538438769,
“updatedAt”: 1693539887893,
“createdBy”: “acme@AdobeID”,
“updatedBy”: “acme@AdobeID”,
“createdClient”: “acme_client”,
“updatedClient”: “acme_client”,
“sandboxId”: “1bd86660-c5da-11e9-93d4-6d5fc3a66a8e”,
“sandboxName”: “dev”,
“imsOrgId”: “5C1328435BF324E90A49402A@AdobeOrg”,
“flowId”: “dbc5c132-bc2a-4625-85c1-32bc2a262558”,
“providerRefId”: “M-c0cb4b5b-367f-4946-a6cc-f7ccfe005b89-incremental-0:911c77de-7d0c-4d10-a3cb-26020efd1171”,
“etag”: “"56010101-0000-1b00-0000-64f15e2f0000"”,
“metrics”: {
“durationSummary”: {
“startedAtUTC”: 1693538422921,
“completedAtUTC”: 1693539869854
},
“recordSummary”: {
“failedInfo”: [{
“code”: “2200”,
“message”: “A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond”
}]
},
“statusSummary”: {
“status”: “failed”,
“errors”: [{
“code”: “CONNECTOR-1001-500”,
“message”: “Error in copying the data from Source.”
}],
“activityRefs”: [“4f008a00-3a04-11eb-adc1-0242ac120002”]
}
},
“activities”: [{
“id”: “4f008a00-3a04-11eb-adc1-0242ac120002”,
“name”: “SFTP Copy Activity”,
“updatedAtUTC”: 0,
“durationSummary”: {
“startedAtUTC”: 1693538422921,
“completedAtUTC”: 1693539869854
},
“latencySummary”: {},
“sizeSummary”: {},
“recordSummary”: {
“failedInfo”: [{
“code”: “2200”,
“message”: “A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond”
}]
},
“fileSummary”: {},
“statusSummary”: {
“status”: “failed”,
“errors”: [{
“code”: “CONNECTOR-1001-500”,
“message”: “Error in copying the data from Source”
}],
“extensions”: {
“errorDetail”: “ErrorCode=SftpNetworkIssue,‘Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Meet network issue when connect to Sftp server ‘13.55.109.14’, SocketErrorCode: ‘TimedOut’.,Source=Microsoft.DataTransfer.ClientLibrary.SftpConnector,’‘Type=System.Net.Sockets.SocketException,Message=A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond,Source=Renci.SshNet,’”,
“errors”: [{
“code”: “2200”,
“message”: “A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond”
}]
}
}
}],
“flowName”: “Dataflow - wx_medallia_export_combined.csv”
}
|
| Sources Flow Run Delay | Ingestion Delay | This alert triggers when a batch ingestion flow run takes longer than 150 minutes to process.
NOTE: The delay alert evaluation will stop after 10 hours, even if the issue still exists. |
{
“id”: “c21ddbcc-cec2-4a63-9ddb-cccec2fa6360”,
“status”: “FIRING”,
“name”: “sources_flow_run_delay_e2e_va7_prod”,
“message”: “Triggered : from imsOrg - Sources Flow Run Delay2 observability_e2e_test above 150 minutes. The current value is 1 minutes.”,
“createdAt”: “2023-09-01T04:27:44.922Z”,
“severity”: “high”,
“imsOrgId”: “5C1328435BF324E90A49402A@AdobeOrg”,
“sandboxName”: “observability-01”,
“sandboxId”: “1bd86660-c5da-11e9-93d4-6d5fc3a66a8e”,
“value”: “1”,
“url”: “https://experience.adobe.com/#/@9C991D2E622D76190A495E39@AdobeOrg/sname:observability-01/platform/source/dataflows/de887077-5cf6-425f-9472-257168ad3c97/activity/test-f9d2a873-28c7-402d-891a-3f19dd6b4ad7”,
“flowId”: “dbc5c132-bc2a-4625-85c1-32bc2a262558”,
“flowRunId”: “test-f9d2a873-28c7-402d-891a-3f19dd6b4ad7”,
header": {
“_adobeio”: {
“imsOrgId”: “5C1328435BF324E90A49402A@AdobeOrg”,
“providerMetadata”: “aep_observability_catalog_events”,
“eventCode”: “source_flow_run_error”
}
}
}
|
| Sources Ingestion Error Rate Exceeded | Ingestion Failure | This alert triggers when the ratio of failed records to all records exceed a threshold of 0.5%.
NOTE: This alert supports both batch and streaming source ingestion. |
{
“id”: “b391018e-eccc-4906-9101-8eecccb906a9”,
“status”: “INACTIVE”,
“name”: “sources_ingestion_error_rate_exceeded”,
“message”: “Resolved : Sources Ingestion Error Rate Exceeded is above 1%. The current value is 2%.”,
“createdAt”: “2023-09-01T00:46:54.661Z”,
“resolvedAt”: “2023-09-01T04:31:54.661Z”,
“severity”: “high”,
“imsOrgId”: “5C1328435BF324E90A49402A@AdobeOrg”,
“sandboxName”: “prod”,
“sandboxId”: “1bd86660-c5da-11e9-93d4-6d5fc3a66a8e”,
“value”: “2”,
“url”: “https://experience.adobe.com/#/@777B575E55828EBB7F000101@AdobeOrg/sname:prod/platform/source/dataflows/4045eb32-95e2-4c54-a6b2-07209c43fff7/activity”,
“flowId”: “dbc5c132-bc2a-4625-85c1-32bc2a262558”
}
|
| Sources Flow Run Info | Streaming Sources Completed | This alert triggers when data has completed processing from a streaming source dataflow run. |
{
“id”: “befcac5b-51c8-4bce-92ae-d7b92fddad21”,
“createdAt”: 1697579102733,
“updatedAt”: 1697582278978,
“createdBy”: “acme@AdobeID”,
“updatedBy”: “acme@AdobeID”,
“createdClient”: “acme_foundation_connectors”,
“updatedClient”: “acme_foundation_connectors”,
“sandboxId”: “1bd86660-c5da-11e9-93d4-6d5fc3a66a8e”,
“sandboxName”: “prod”,
“imsOrgId”: “5C1328435BF324E90A49402A@AdobeOrg”,
“flowId”: “dbc5c132-bc2a-4625-85c1-32bc2a262558”,
“providerRefId”: “1697576400000-1697580000000”,
“providerRefId”: “1697576400000-1697580000000”,
“etag”: “"0e0158eb-0000-0d00-0000-64ee4dc70000"”,
“metrics”: {
“durationSummary”: {
“startedAtUTC”: 1697576400000,
“completedAtUTC”: 1697582277000
},
“latencySummary”: {
“minMs”: 1417,
“maxMs”: 591304
},
“recordSummary”: {
“inputRecordCount”: 10,
“createdRecordCount”: 5,
“failedRecordCount”: 0,
“warningRecordCount”: 0,
“ingestedRecordPercentage”: 50
},
“statusSummary”: {
“status”: “partialSuccess”
}
},
“flowName”: “Streaming Connection for dataset Id 5dcb24b84d955318add54eb1”,
“flowType”: “streaming”,
“message”: “Streaming Sources flow run Streaming Connection for dataset Id 5dcb24b84d955318add54eb1 which started at 2023-10-17 21:45:02 completed, with 5 Records ingested and Ingestion rate is 50.”,
“url”: “https://experience-stage.adobe.com/@4E5F3EB95C746F890A49400A@AdobeOrg/sname:prod/platform/source/dataflows/10bebc5d-66c4-4382-bebc-5d66c4d38295/activity/befcac5b-51c8-4bce-92ae-d7b92fddad21”
}
|