Documentation Experience Platform Data Prep Guide

Data Prep mapping functions

Last update: October 9, 2024

Topics:
Data Prep

CREATED FOR:

Developer

Data Prep functions can be used to compute and calculate values based on what is entered in source fields.

Fields

A field name can be any legal identifier - an unlimited-length sequence of Unicode letters and digits, beginning with a letter, the dollar sign ($), or the underscore character (_). Variable names are also case sensitive.

If a field name does not follow this convention, the field name must be wrapped with ${}. So, for example, if the field name is “First Name” or “First.Name”, then the name must be wrapped like ${First Name} or ${First\.Name} respectively.

TIP

When interacting with hierarchies, if a child attribute has a period (.), you must use a backslash (\) to escape special characters. For more information, read the guide on escaping special characters.

If a field name is any of the following reserved keywords, it must be wrapped with ${}{}:

new, mod, or, break, var, lt, for, false, while, eq, gt, div, not, null, continue, else, and, ne, true, le, if, ge, return, _errors, do, function, empty, size

Additionally, reserved keywords also include any of the mapper functions listed on this page.

Data within sub-fields can be accessed by using the dot notation. For example, if there was a name object, to access the firstName field, use name.firstName.

List of functions

The following tables list all supported mapping functions, including sample expressions and their resulting outputs.

String functions

NOTE

Please scroll left/right to view the full contents of the table.

Function	Description	Parameters	Syntax	Expression	Sample output
concat	Concatenates the given strings.	STRING: The strings that will be concatenated.	concat(STRING_1, STRING_2)	concat("Hi, ", “there”, “!”)	`"Hi, there!"`
explode	Splits the string based on a regex and returns an array of parts. Can optionally include regex to split the string. By default, the splitting resolves to “,”. The following delimiters need to be escaped with `\`: `+, ?, ^, \|, ., [, (, {, ), *, $, \` If you include multiple characters as the delimiter, the delimiter will be treated as a multi-character delimiter.	STRING: Required The string that needs to be split. REGEX: Optional The regular expression that can be used to split the string.	explode(STRING, REGEX)	explode(“Hi, there!”, " ")	`["Hi,", "there"]`
instr	Returns the location/index of a substring.	INPUT: Required The string that is being searched. SUBSTRING: Required The substring that is being searched for within the string. START_POSITION: Optional The location of where to start looking in the string. OCCURRENCE: Optional The nth occurrence to look for from the start position. By default, it is 1.	instr(INPUT, SUBSTRING, START_POSITION, OCCURRENCE)	instr(“adobe.com”, “com”)	6
replacestr	Replaces the search string if present in original string.	INPUT: Required The input string. TO_FIND: Required The string to look up within the input. TO_REPLACE: Required The string that will replace the value within “TO_FIND”.	replacestr(INPUT, TO_FIND, TO_REPLACE)	replacestr(“This is a string re test”, “re”, “replace”)	“This is a string replace test”
substr	Returns a substring of a given length.	INPUT: Required The input string. START_INDEX: Required The index of the input string where the substring starts. LENGTH: Required The length of the substring.	substr(INPUT, START_INDEX, LENGTH)	substr(“This is a substring test”, 7, 8)	" a subst"
lower / lcase	Converts a string to lowercase.	INPUT: Required The string that will be converted to lowercase.	lower(INPUT)	lower(“HeLLo”) lcase(“HeLLo”)	“hello”
upper / ucase	Converts a string to uppercase.	INPUT: Required The string that will be converted to uppercase.	upper(INPUT)	upper(“HeLLo”) ucase(“HeLLo”)	“HELLO”
split	Splits an input string on a separator. The following separator needs to be escaped with `\`: `\`. If you include multiple delimiters, the string will split on any of the delimiters present in the string. Note: This function only returns non-null indexes from the string, regardless of the presence of the separator. If all indexes, including nulls, are required in the resulting array, use the “explode” function instead.	INPUT: Required The input string that is going to be split. SEPARATOR: Required The string that is used to split the input.	split(INPUT, SEPARATOR)	split(“Hello world”, " ")	`["Hello", "world"]`
join	Joins a list of objects using the separator.	SEPARATOR: Required The string that will be used to join the objects. OBJECTS: Required An array of strings that will be joined.	`join(SEPARATOR, [OBJECTS])`	`join(" ", to_array(true, "Hello", "world"))`	“Hello world”
lpad	Pads the left side of a string with the other given string.	INPUT: Required The string that is going to be padded out. This string can be null. COUNT: Required The size of the string to be padded out. PADDING: Required The string to pad the input with. If null or empty, it will be treated as a single space.	lpad(INPUT, COUNT, PADDING)	lpad(“bat”, 8, “yz”)	“yzyzybat”
rpad	Pads the right side of a string with the other given string.	INPUT: Required The string that is going to be padded out. This string can be null. COUNT: Required The size of the string to be padded out. PADDING: Required The string to pad the input with. If null or empty, it will be treated as a single space.	rpad(INPUT, COUNT, PADDING)	rpad(“bat”, 8, “yz”)	“batyzyzy”
left	Gets the first “n” characters of the given string.	STRING: Required The string you are getting the first “n” characters for. COUNT: Required The “n” characters you want to get from the string.	left(STRING, COUNT)	left(“abcde”, 2)	“ab”
right	Gets the last “n” characters of the given string.	STRING: Required The string you are getting the last “n” characters for. COUNT: Required The “n” characters you want to get from the string.	right(STRING, COUNT)	right(“abcde”, 2)	“de”
ltrim	Removes the whitespace from the beginning of the string.	STRING: Required The string you want to remove the whitespace from.	ltrim(STRING)	ltrim(" hello")	“hello”
rtrim	Removes the whitespace from the end of the string.	STRING: Required The string you want to remove the whitespace from.	rtrim(STRING)	rtrim("hello ")	“hello”
trim	Removes the whitespace from the beginning and the end of the string.	STRING: Required The string you want to remove the whitespace from.	trim(STRING)	trim(" hello ")	“hello”
equals	Compares two strings to confirm if they are equal. This function is case sensitive.	STRING1: Required The first string you want to compare. STRING2: Required The second string you want to compare.	STRING1.equals(STRING2)	“string1”.equals(“STRING1”)	false
equalsIgnoreCase	Compares two strings to confirm if they are equal. This function is not case sensitive.	STRING1: Required The first string you want to compare. STRING2: Required The second string you want to compare.	STRING1.equalsIgnoreCase(STRING2)	“string1”.equalsIgnoreCase("STRING1)	true

Regular expression functions

Function	Description	Parameters	Syntax	Expression	Sample output
extract_regex	Extracts groups from the input string, based on a regular expression.	STRING: Required The string that you are extracting the groups from. REGEX: Required The regular expression that you want the group to match.	extract_regex(STRING, REGEX)	extract_regex("E259,E259B_009,1_1", “([^,]+),[,]*,([^,]+)”)	[“E259,E259B_009,1_1”, “E259”, “1_1”]
matches_regex	Checks to see if the string matches against the inputted regular expression.	STRING: Required The string that you are checking matches the regular expression. REGEX: Required The regular expression that you are comparing against.	matches_regex(STRING, REGEX)	matches_regex(“E259,E259B_009,1_1”, “([^,]+),[,]*,([^,]+)”)	true

Hashing functions

NOTE

Please scroll left/right to view the full contents of the table.

Function	Description	Parameters	Syntax	Expression	Sample output
sha1	Takes an input and produces a hash value using Secure Hash Algorithm 1 (SHA-1).	INPUT: Required The plain text to be hashed. CHARSET: Optional The name of the character set. Possible values include UTF-8, UTF-16, ISO-8859-1, and US-ASCII.	sha1(INPUT, CHARSET)	sha1(“my text”, “UTF-8”)	c3599c11e47719df18a2448690840c5dfcce3c80
sha256	Takes an input and produces a hash value using Secure Hash Algorithm 256 (SHA-256).	INPUT: Required The plain text to be hashed. CHARSET: Optional The name of the character set. Possible values include UTF-8, UTF-16, ISO-8859-1, and US-ASCII.	sha256(INPUT, CHARSET)	sha256(“my text”, “UTF-8”)	7330d2b39ca35eaf4cb95fc846c21ee6a39af698154a83a586ee270a0d372104
sha512	Takes an input and produces a hash value using Secure Hash Algorithm 512 (SHA-512).	INPUT: Required The plain text to be hashed. CHARSET: Optional The name of the character set. Possible values include UTF-8, UTF-16, ISO-8859-1, and US-ASCII.	sha512(INPUT, CHARSET)	sha512(“my text”, “UTF-8”)	a3d7e45a0d9be5fd4e4b9a3b8c9c2163c21ef708bf11b4232bb21d2a8704ada2cdcd7b367dd0788a89a5c908cfe377aceb1072a7b386b7d4fd2ff68a8fd24d16
md5	Takes an input and produces a hash value using MD5.	INPUT: Required The plain text to be hashed. CHARSET: Optional The name of the character set. Possible values include UTF-8, UTF-16, ISO-8859-1, and US-ASCII.	md5(INPUT, CHARSET)	md5(“my text”, “UTF-8”)	d3b96ce8c9fb4e9bd0198d03ba6852c7
crc32	Takes an input uses a cyclic redundancy check (CRC) algorithm to produce a 32-bit cyclic code.	INPUT: Required The plain text to be hashed. CHARSET: Optional The name of the character set. Possible values include UTF-8, UTF-16, ISO-8859-1, and US-ASCII.	crc32(INPUT, CHARSET)	crc32(“my text”, “UTF-8”)	8df92e80

URL functions

NOTE

Please scroll left/right to view the full contents of the table.

Function	Description	Parameters	Syntax	Expression	Sample output
get_url_protocol	Returns the protocol from the given URL. If the input is invalid, it returns null.	URL: Required The URL from which the protocol needs to be extracted.	get_url_protocol(URL)	get_url_protocol(“https://platform.adobe.com/home”)	https
get_url_host	Returns the host of the given URL. If the input is invalid, it returns null.	URL: Required The URL from which the host needs to be extracted.	get_url_host(URL)	get_url_host(“https://platform.adobe.com/home”)	platform.adobe.com
get_url_port	Returns the port of the given URL. If the input is invalid, it returns null.	URL: Required The URL from which the port needs to be extracted.	get_url_port(URL)	get_url_port(“sftp://example.com//home/joe/employee.csv”)	22
get_url_path	Returns the path of the given URL. By default, the full path is returned.	URL: Required The URL from which the path needs to be extracted. FULL_PATH: Optional A boolean value that determines if the full path is returned. If set to false, only the end of the path is returned.	get_url_path(URL, FULL_PATH)	get_url_path(“sftp://example.com//home/joe/employee.csv”)	“//home/joe/employee.csv”
get_url_query_str	Returns the query string of a given URL as a map of query string name and query string value.	URL: Required The URL that you are trying to get the query string from. ANCHOR: Required Determines what will be done with the anchor in the query string. Can be one of three values: “retain”, “remove”, or “append”. If the value is “retain”, the anchor will be attached to the returned value. If the value is “remove”, the anchor will be removed from the returned value. If the value is “append”, the anchor will be returned as a separate value.	get_url_query_str(URL, ANCHOR)	get_url_query_str(“foo://example.com:8042/over/there?name=ferret#nose”, “retain”) get_url_query_str(“foo://example.com:8042/over/there?name=ferret#nose”, “remove”) get_url_query_str(“foo://example.com:8042/over/there?name=ferret#nose”, “append”)	`{"name": "ferret#nose"}` `{"name": "ferret"}` `{"name": "ferret", "_anchor_": "nose"}`
get_url_encoded	This function takes a URL as input and replaces or encodes the special characters with ASCII characters. For more information on special characters, please read the list of special characters in the appendix of this document.	URL: Required The input URL with special characters that you want to replace or encode with ASCII characters.	get_url_encoded(URL)	get_url_encoded(“https://example.com/partneralliance_asia-pacific_2022”)	https%3A%2F%2Fexample.com%2Fpartneralliance_asia-pacific_2022
get_url_decoded	This function takes a URL as input and decodes the ASCII characters into special characters. For more information on special characters, please read the list of special characters in the appendix of this document.	URL: Required The input URL with ASCII characters that you want to decode into special characters.	get_url_decoded(URL)	get_url_decoded(“https%3A%2F%2Fexample.com%2Fpartneralliance_asia-pacific_2022”)	https://example.com/partneralliance_asia-pacific_2022

Date and time functions

NOTE

Please scroll left/right to view the full contents of the table. More information about the date function can be found in the dates section of the data format handling guide.

Function	Description	Parameters	Syntax	Expression	Sample output
now	Retrieves the current time.		now()	now()	`2021-10-26T10:10:24Z`
timestamp	Retrieves the current Unix time.		timestamp()	timestamp()	1571850624571
format	Formats the input date according to a specified format.	DATE: Required The input date, as a ZonedDateTime object, that you want to format. FORMAT: Required The format that you want the date to be changed to.	format(DATE, FORMAT)	format(2019-10-23T11:24:00+00:00, “`yyyy-MM-dd HH:mm:ss`”)	`2019-10-23 11:24:35`
dformat	Converts a timestamp to a date string according to a specified format.	TIMESTAMP: Required The timestamp you want to format. This is written in milliseconds. FORMAT: Required The format that you want the timestamp to become.	dformat(TIMESTAMP, FORMAT)	dformat(1571829875000, “`yyyy-MM-dd'T'HH:mm:ss.SSSX`”)	`2019-10-23T11:24:35.000Z`
date	Converts a date string into a ZonedDateTime object (ISO 8601 format).	DATE: Required The string that represents the date. FORMAT: Required The string representing the format of the source date.Note: This does not represent the format you want to convert the date string into. DEFAULT_DATE: Required The default date returned, if the date provided is null.	date(DATE, FORMAT, DEFAULT_DATE)	date(“2019-10-23 11:24”, “yyyy-MM-dd HH:mm”, now())	`2019-10-23T11:24:00Z`
date	Converts a date string into a ZonedDateTime object (ISO 8601 format).	DATE: Required The string that represents the date. FORMAT: Required The string representing the format of the source date.Note: This does not represent the format you want to convert the date string into.	date(DATE, FORMAT)	date(“2019-10-23 11:24”, “yyyy-MM-dd HH:mm”)	`2019-10-23T11:24:00Z`
date	Converts a date string into a ZonedDateTime object (ISO 8601 format).	DATE: Required The string that represents the date.	date(DATE)	date(“2019-10-23 11:24”)	“2019-10-23T11:24:00Z”
date_part	Retrieves the parts of the date. The following component values are supported: “year” “yyyy” “yy” “quarter” “qq” “q” “month” “mm” “m” “dayofyear” “dy” “y” “day” “dd” “d” “week” “ww” “w” “weekday” “dw” “w” “hour” “hh” “hh24” “hh12” “minute” “mi” “n” “second” “ss” “s” “millisecond” “SSS”	COMPONENT: Required A string representing the part of the date. DATE: Required The date, in a standard format.	date_part(COMPONENT, DATE)	date_part(“MM”, date(“2019-10-17 11:55:12”))	10
set_date_part	Replaces a component in a given date. The following components are accepted: “year” “yyyy” “yy” “month” “mm” “m” “day” “dd” “d” “hour” “hh” “minute” “mi” “n” “second” “ss” “s”	COMPONENT: Required A string representing the part of the date. VALUE: Required The value to set for the component for a given date. DATE: Required The date, in a standard format.	set_date_part(COMPONENT, VALUE, DATE)	set_date_part(“m”, 4, date(“2016-11-09T11:44:44.797”)	“2016-04-09T11:44:44Z”
make_date_time	Creates a date from parts. This function can also be induced using make_timestamp.	YEAR: Required The year, written in four digits. MONTH: Required The month. The allowed values are 1 to 12. DAY: Required The day. The allowed values are 1 to 31. HOUR: Required The hour. The allowed values are 0 to 23. MINUTE: Required The minute. The allowed values are 0 to 59. NANOSECOND: Required The nanosecond values. The allowed values are 0 to 999999999. TIMEZONE: Required The timezone for the date time.	make_date_time(YEAR, MONTH, DAY, HOUR, MINUTE, SECOND, NANOSECOND, TIMEZONE)	make_date_time(2019, 10, 17, 11, 55, 12, 999, “America/Los_Angeles”)	`2019-10-17T11:55:12Z`
zone_date_to_utc	Converts a date in any timezone to a date in UTC.	DATE: Required The date that you are trying to convert.	zone_date_to_utc(DATE)	`zone_date_to_utc(2019-10-17T11:55:12 PST`	`2019-10-17T19:55:12Z`
zone_date_to_zone	Converts a date from one timezone to another timezone.	DATE: Required The date that you are trying to convert. ZONE: Required The timezone that you are trying to convert the date to.	zone_date_to_zone(DATE, ZONE)	`zone_date_to_zone(now(), "Europe/Paris")`	`2021-10-26T15:43:59Z`

Hierarchies - Objects

NOTE

Please scroll left/right to view the full contents of the table.

Function	Description	Parameters	Syntax	Expression	Sample output
is_empty	Checks whether or not an object is empty.	INPUT: Required The object that you’re trying to check is empty.	is_empty(INPUT)	`is_empty([1, null, 2, 3])`	false
arrays_to_object	Creates a list of objects.	INPUT: Required A grouping of key and array pairs.	arrays_to_object(INPUT)	`arrays_to_objects('sku', explode("id1\|id2", '\\\|'), 'price', [22.5,14.35])`	`[{ "sku": "id1", "price": 22.5 }, { "sku": "id2", "price": 14.35 }]`
to_object	Creates an object based on the flat key/value pairs given.	INPUT: Required A flat list of key/value pairs.	to_object(INPUT)	to_object(“firstName”, “John”, “lastName”, “Doe”)	`{"firstName": "John", "lastName": "Doe"}`
str_to_object	Creates an object from the input string.	STRING: Required The string that is being parsed to create an object. VALUE_DELIMITER: Optional The delimiter that separates a field from the value. The default delimiter is `:`. FIELD_DELIMITER: Optional The delimiter that separates field value pairs. The default delimiter is `,`.	str_to_object(STRING, VALUE_DELIMITER, FIELD_DELIMITER) Note: You can use the `get()` function along with `str_to_object()` to retrieve values for the keys in the string.	Example #1: str_to_object(“firstName - John ; lastName - ; - 123 345 7890”, “-”, “;”) Example #2: str_to_object(“firstName - John ; lastName - ; phone - 123 456 7890”, “-”, “;”).get(“firstName”)	Example #1:`{"firstName": "John", "lastName": "Doe", "phone": "123 456 7890"}` Example #2: “John”
contains_key	Checks if the object exists within the source data. Note: This function replaces the deprecated `is_set()` function.	INPUT: Required The path to be checked if it exists within the source data.	contains_key(INPUT)	contains_key(“evars.evar.field1”)	true
nullify	Sets the value of the attribute to `null`. This should be used when you do not want to copy the field to the target schema.		nullify()	nullify()	`null`
get_keys	Parses the key/value pairs and returns all the keys.	OBJECT: Required The object where the keys will be extracted from.	get_keys(OBJECT)	get_keys({“book1”: “Pride and Prejudice”, “book2”: “1984”})	`["book1", "book2"]`
get_values	Parses the key/value pairs and returns the value of the string, based on the given key.	STRING: Required The string that you want to parse. KEY: Required The key for which the value has to be extracted. VALUE_DELIMITER: Required The delimiter that separates the field and the value. If either a `null` or an empty string are provided, this value is `:`. FIELD_DELIMITER: Optional The delimiter that separates field and value pairs. If either a `null` or an empty string are provided, this value is `,`.	get_values(STRING, KEY, VALUE_DELIMITER, FIELD_DELIMITER)	get_values("firstName - John , lastName - Cena , phone - 555 420 8692", "firstName", "-", ",")	John
map_get_values	Takes a map and a key input. If the input is a single key, then the function returns the value associated with that key. If the input is a string array, then the function returns all values corresponding to the keys provided. If the incoming map has duplicate keys, the return value must de-duplicate the keys and return unique values.	MAP: Required The input map data. KEY: Required The key can be a single string or a string array. If any other primitive type (data / number) is provided, then it is treated as a string.	get_values(MAP, KEY)	Please see the appendix for a code sample.
map_has_keys	If one or more input keys are provided, then the function returns true. If a string array is provided as input, then the function returns true on the first key that is found.	MAP: Required The input map data KEY: Required The key can be a single string or a string array. If any other primitive type (data / number) is provided, then it is treated as a string.	map_has_keys(MAP, KEY)	Please see the appendix for a code sample.
add_to_map	Accepts at least two inputs. Any number of maps can be provided as inputs. Data Prep returns a single map that has all key-value pairs from all the inputs. If one or more keys are repeated (in the same map or across maps), Data Prep de-duplicates the keys so that the first key-value pair persists in the order that they were passed in the input.	MAP: Required The input map data.	add_to_map(MAP 1, MAP 2, MAP 3, …)	Please see the appendix for a code sample.
object_to_map (Syntax 1)	Use this function to create Map data types.	KEY: Required Keys must be a string. If any other primitive values such as integers or dates are provided, then they are auto-converted to strings and are treated as strings. ANY_TYPE: Required Refers to any supported XDM data type except Maps.	object_to_map(KEY, ANY_TYPE, KEY, ANY_TYPE, … )	Please see the appendix for a code sample.
object_to_map (Syntax 2)	Use this function to create Map data types.	OBJECT: Required You can provide an incoming object or object array and point to an attribute inside the object as key.	object_to_map(OBJECT)	Please see the appendix for a code sample.
object_to_map (Syntax 3)	Use this function to create Map data types.	OBJECT: Required You can provide an incoming object or object array and point to an attribute inside the object as key.	object_to_map(OBJECT_ARRAY, ATTRIBUTE_IN_OBJECT_TO_BE_USED_AS_A_KEY)	Please see the appendix for a code sample.

For information on the object copy feature, see the section below.

Hierarchies - Arrays

NOTE

Please scroll left/right to view the full contents of the table.

Function	Description	Parameters	Syntax	Expression	Sample output
coalesce	Returns the first non-null object in a given array.	INPUT: Required The array you want to find the first non-null object of.	coalesce(INPUT)	coalesce(null, null, null, “first”, null, “second”)	“first”
first	Retrieves the first element of the given array.	INPUT: Required The array you want to find the first element of.	first(INPUT)	first(“1”, “2”, “3”)	“1”
last	Retrieves the last element of the given array.	INPUT: Required The array you want to find the last element of.	last(INPUT)	last(“1”, “2”, “3”)	“3”
add_to_array	Adds elements to the end of the array.	ARRAY: Required The array that you are adding elements to. VALUES: The elements that you want to append to the array.	add_to_array(ARRAY, VALUES)	add_to_array([‘a’, ‘b’], ‘c’, ‘d’)	[‘a’, ‘b’, ‘c’, ‘d’]
join_arrays	Combines the arrays with each other.	ARRAY: Required The array that you are adding elements to. VALUES: The array(s) you want to append to the parent array.	join_arrays(ARRAY, VALUES)	join_arrays([‘a’, ‘b’], [‘c’], [‘d’, ‘e’])	[‘a’, ‘b’, ‘c’, ‘d’, ‘e’]
to_array	Takes a list of inputs and converts it to an array.	INCLUDE_NULLS: Required A boolean value to indicate whether or not to include nulls in the response array. VALUES: Required The elements that are to be converted to an array.	to_array(INCLUDE_NULLS, VALUES)	to_array(false, 1, null, 2, 3)	`[1, 2, 3]`
size_of	Returns the size of the input.	INPUT: Required The object that you’re trying to find the size of.	size_of(INPUT)	`size_of([1, 2, 3, 4])`	4
upsert_array_append	This function is used to append all elements in the entire input array to the end of the array in Profile. This function is only applicable during updates. If used in the context of inserts, this function returns the input as is.	ARRAY: Required The array to append the array in the Profile.	upsert_array_append(ARRAY)	`upsert_array_append([123, 456])`	[123, 456]
upsert_array_replace	This function is used to replace elements in an array. This function is only applicable during updates. If used in the context of inserts, this function returns the input as is.	ARRAY: Required The array to replace the array in the Profile.	upsert_array_replace(ARRAY)	`upsert_array_replace([123, 456], 1)`	[123, 456]
Destinations only array_to_string	Joins the string representations of the elements in an array using the specified separator. If the array is multidimensional, it is flattened before being joined. Note: This function is used in destinations. Read the documentation for more information.	SEPARATOR: Required The separator used to join the elements in the array. ARRAY: Required The array that be joined (after flattening).	array_to_string(SEPARATOR, ARRAY)	`array_to_string(";", ["Hello", "world"])`	“Hello;world”
Destinations only filterArray*	Filters the given array based on a predicate. Note: This function is used in destinations. Read the documentation for more information.	ARRAY: Required The array to be filtered PREDICATE: Required The predicate to be applied on each element of the given array.	filterArray(ARRAY, PREDICATE)	`filterArray([5, -6, 0, 7], x -> x > 0)`	[5, 7]
Destinations only transformArray*	Transforms the given array based on a predicate. Note: This function is used in destinations. Read the documentation for more information.	ARRAY: Required The array to be transformed. PREDICATE: Required The predicate to be applied on each element of the given array.	transformArray(ARRAY, PREDICATE)	`transformArray([5, 6, 7], x -> x + 1)`	[6, 7, 8]
Destinations only flattenArray*	Flattens the given (multidimensional) array to a unidimensional array. Note: This function is used in destinations. Read the documentation for more information.	ARRAY: Required The array to be flattened.	flattenArray(ARRAY)	flattenArray([[[‘a’, ‘b’], [‘c’, ‘d’]], [[‘e’], [‘f’]]])	[‘a’, ‘b’, ‘c’, ‘d’, ‘e’, ‘f’]

Hierarchies - Map

NOTE

Please scroll left/right to view the full contents of the table.

Function	Description	Parameters	Syntax	Expression	Sample output
array_to_map	This function takes an object array and a key as input and returns a map of key’s field with the value as key and the array element as value.	INPUT: Required The object array you want to find the first non-null object of. KEY: Required The key must be a field name in the object array and the object as value.	array_to_map(OBJECT[] INPUTS, KEY)	Read the appendix for a code sample.
object_to_map	This function takes an object as an argument and returns a map of key-value pairs.	INPUT: Required The object array you want to find the first non-null object of.	object_to_map(OBJECT_INPUT)	"object_to_map(address) where input is " + “address: {line1 : "345 park ave",line2: "bldg 2",City : "san jose",State : "CA",type: "office"}”	Returns a map with given field name and value pairs or null if input is null. For example: `"{line1 : \"345 park ave\",line2: \"bldg 2\",City : \"san jose\",State : \"CA\",type: \"office\"}"`
to_map	This function takes a list of ke-value pairs and returns a map of key-value pairs.		to_map(OBJECT_INPUT)	“to_map("firstName", "John", "lastName", "Doe")”	Returns a map with given field name and value pairs or null if input is null. For example: `"{\"firstName\" : \"John\", \"lastName\": \"Doe\"}"`

Logical operators

NOTE

Please scroll left/right to view the full contents of the table.

Function	Description	Parameters	Syntax	Expression	Sample output
decode	Given a key and a list of key value pairs flattened as an array, the function returns the value if key is found or return a default value if present in the array.	KEY: Required The key to be matched. OPTIONS: Required A flattened array of key/value pairs. Optionally, a default value can be put at the end.	decode(KEY, OPTIONS)	decode(stateCode, “ca”, “California”, “pa”, “Pennsylvania”, “N/A”)	If the stateCode given is “ca”, “California”. If the stateCode given is “pa”, “Pennsylvania”. If the stateCode doesn’t match the following, “N/A”.
iif	Evaluates a given boolean expression and returns the specified value based on the result.	EXPRESSION: Required The boolean expression that is being evaluated. TRUE_VALUE: Required The value that is returned if the expression evaluates to true. FALSE_VALUE: Required The value that is returned if the expression evaluates to false.	iif(EXPRESSION, TRUE_VALUE, FALSE_VALUE)	iif(“s”.equalsIgnoreCase(“S”), “True”, “False”)	“True”

Aggregation

NOTE

Please scroll left/right to view the full contents of the table.

Function	Description	Parameters	Syntax	Expression	Sample output
min	Returns the minimum of the given arguments. Uses natural ordering.	OPTIONS: Required One or more objects that can be compared to each other.	min(OPTIONS)	min(3, 1, 4)	1
max	Returns the maximum of the given arguments. Uses natural ordering.	OPTIONS: Required One or more objects that can be compared to each other.	max(OPTIONS)	max(3, 1, 4)	4

Type conversions

NOTE

Please scroll left/right to view the full contents of the table.

Function	Description	Parameters	Syntax	Expression	Sample output
to_bigint	Converts a string to a BigInteger.	STRING: Required The string that is to be converted to a BigInteger.	to_bigint(STRING)	to_bigint(“1000000.34”)	1000000.34
to_decimal	Converts a string to a Double.	STRING: Required The string that is to be converted to a Double.	to_decimal(STRING)	to_decimal(“20.5”)	20.5
to_float	Converts a string to a Float.	STRING: Required The string that is to be converted to a Float.	to_float(STRING)	to_float(“12.3456”)	12.34566
to_integer	Converts a string to an Integer.	STRING: Required The string that is to be converted to an Integer.	to_integer(STRING)	to_integer(“12”)	12

JSON functions

NOTE

Please scroll left/right to view the full contents of the table.

Function	Description	Parameters	Syntax	Expression	Sample output
json_to_object	Deserialize JSON content from the given string.	STRING: Required The JSON string to be deserialized.	json_to_object(STRING)	json_to_object({“info”:{“firstName”:“John”,“lastName”: “Doe”}})	An object representing the JSON.

Special operations

NOTE

Please scroll left/right to view the full contents of the table.

Function	Description	Parameters	Syntax	Expression	Sample output
uuid / guid	Generates a pseudo-random ID.		uuid() guid()	uuid() guid()	7c0267d2-bb74-4e1a-9275-3bf4fccda5f4 c7016dc7-3163-43f7-afc7-2e1c9c206333
`fpid_to_ecid`	This function takes an FPID string and converts it into an ECID to be used in Adobe Experience Platform and Adobe Experience Cloud applications.	STRING: Required The FPID string to be converted into ECID.	`fpid_to_ecid(STRING)`	`fpid_to_ecid("4ed70bee-b654-420a-a3fd-b58b6b65e991")`	`"28880788470263023831040523038280731744"`

User agent functions

Any of the user agent functions contained in the table below can return either of the following values:

Phone - A mobile device with a small screen (commonly < 7")
Mobile - A mobile device that is yet to be identified. This mobile device can be an eReader, a tablet, a phone, a watch, etc.

For more information on device field values, please read the list of device field values in the appendix of this document.

NOTE

Please scroll left/right to view the full contents of the table.

Function	Description	Parameters	Syntax	Expression	Sample output
ua_os_name	Extracts the operating system name from the user agent string.	USER_AGENT: Required The user agent string.	ua_os_name(USER_AGENT)	ua_os_name(“Mozilla/5.0 (iPhone; CPU iPhone OS 5_1_1 like Mac OS X) AppleWebKit/534.46 (KHTML, like Gecko) Version/5.1 Mobile/9B206 Safari/7534.48.3”)	iOS
ua_os_version_major	Extracts the operating system’s major version from the user agent string.	USER_AGENT: Required The user agent string.	ua_os_version_major(USER_AGENT)	ua_os_version_majors(“Mozilla/5.0 (iPhone; CPU iPhone OS 5_1_1 like Mac OS X) AppleWebKit/534.46 (KHTML, like Gecko) Version/5.1 Mobile/9B206 Safari/7534.48.3”)	iOS 5
ua_os_version	Extracts the operating system’s version from the user agent string.	USER_AGENT: Required The user agent string.	ua_os_version(USER_AGENT)	ua_os_version(“Mozilla/5.0 (iPhone; CPU iPhone OS 5_1_1 like Mac OS X) AppleWebKit/534.46 (KHTML, like Gecko) Version/5.1 Mobile/9B206 Safari/7534.48.3”)	5.1.1
ua_os_name_version	Extracts the operating system’s name and version from the user agent string.	USER_AGENT: Required The user agent string.	ua_os_name_version(USER_AGENT)	ua_os_name_version(“Mozilla/5.0 (iPhone; CPU iPhone OS 5_1_1 like Mac OS X) AppleWebKit/534.46 (KHTML, like Gecko) Version/5.1 Mobile/9B206 Safari/7534.48.3”)	iOS 5.1.1
ua_agent_version	Extracts the agent version from the user agent string.	USER_AGENT: Required The user agent string.	ua_agent_version(USER_AGENT)	ua_agent_version(“Mozilla/5.0 (iPhone; CPU iPhone OS 5_1_1 like Mac OS X) AppleWebKit/534.46 (KHTML, like Gecko) Version/5.1 Mobile/9B206 Safari/7534.48.3”)	5.1
ua_agent_version_major	Extracts the agent name and major version from the user agent string.	USER_AGENT: Required The user agent string.	ua_agent_version_major(USER_AGENT)	ua_agent_version_major(“Mozilla/5.0 (iPhone; CPU iPhone OS 5_1_1 like Mac OS X) AppleWebKit/534.46 (KHTML, like Gecko) Version/5.1 Mobile/9B206 Safari/7534.48.3”)	Safari 5
ua_agent_name	Extracts the agent name from the user agent string.	USER_AGENT: Required The user agent string.	ua_agent_name(USER_AGENT)	ua_agent_name(“Mozilla/5.0 (iPhone; CPU iPhone OS 5_1_1 like Mac OS X) AppleWebKit/534.46 (KHTML, like Gecko) Version/5.1 Mobile/9B206 Safari/7534.48.3”)	Safari
ua_device_class	Extracts the device class from the user agent string.	USER_AGENT: Required The user agent string.	ua_device_class(USER_AGENT)	ua_device_class(“Mozilla/5.0 (iPhone; CPU iPhone OS 5_1_1 like Mac OS X) AppleWebKit/534.46 (KHTML, like Gecko) Version/5.1 Mobile/9B206 Safari/7534.48.3”)	Phone

Analytics functions

NOTE

You may only use the following analytics functions for WebSDK and Adobe Analytics flows.

Function	Description	Parameters	Syntax	Expression	Sample output
aa_get_event_id	Extracts the event ID from an Analytics event string.	EVENT_STRING: Required The comma-separated Analytics event string. EVENT_NAME: Required The event name to extract and ID from.	aa_get_event_id(EVENT_STRING, EVENT_NAME)	aa_get_event_id(“event101=5:123456,scOpen”, “event101”)	123456
aa_get_event_value	Extracts the event value from an Analytics event string. If the event value is not specified 1 is returned.	EVENT_STRING: Required The comma-separated Analytics event string. EVENT_NAME: Required The event name to extract a value from.	aa_get_event_value(EVENT_STRING, EVENT_NAME)	aa_get_event_value(“event101=5:123456,scOpen”, “event101”)	5
aa_get_product_categories	Extracts the product category from an Analytics products string.	PRODUCTS_STRING: Required The Analytics products string.	aa_get_product_categories(PRODUCTS_STRING)	aa_get_product_categories(“;Example product 1;1;3.50,Example category 2;Example product 2;1;5.99”)	[null,“Example category 2”]
aa_get_product_names	Extracts the product name from an Analytics products string.	PRODUCTS_STRING: Required The Analytics products string.	aa_get_product_names(PRODUCTS_STRING)	aa_get_product_names(“;Example product 1;1;3.50,Example category 2;Example product 2;1;5.99”)	[“Example product 1”,“Example product 2”]
aa_get_product_quantities	Extracts the quantities from an Analytics products string.	PRODUCTS_STRING: Required The Analytics products string.	aa_get_product_quantities(PRODUCTS_STRING)	aa_get_product_quantities(“;Example product 1;1;3.50,Example category 2;Example product 2”)	[“1”, null]
aa_get_product_prices	Extracts the price from an Analytics products string.	PRODUCTS_STRING: Required The Analytics products string.	aa_get_product_prices(PRODUCTS_STRING)	aa_get_product_prices(“;Example product 1;1;3.50,Example category 2;Example product 2”)	[“3.50”, null]
aa_get_product_event_values	Extracts values for the named event from the products string as an array of strings.	PRODUCTS_STRING: Required The Analytics products string. EVENT_NAME: Required The event name to extract values from.	aa_get_product_event_values(PRODUCTS_STRING, EVENT_NAME)	aa_get_product_event_values(“;Example product 1;1;4.20;event1=2.3\|event2=5:1,;Example product 2;1;4.20;event1=3\|event2=2:2”, “event1”)	[“2.3”, “3”]
aa_get_product_evars	Extracts the evar values for the named event from the products string as an array of strings.	PRODUCTS_STRING: Required The Analytics products string. EVAR_NAME: Required The eVar name to extract.	aa_get_product_evars(PRODUCTS_STRING, EVENT_NAME)	aa_get_product_evars(“;Example product;1;6.69;;eVar1=Merchandising value”, “eVar1”)	[“Merchandising value”]

Object copy

TIP

The object copy feature is automatically applied when an object in the source is mapped to an object in the XDM. No additional action needed from users.

You can use the object copy feature to automatically copy attributes of an object without making changes to the mapping. For example, if your source data has a structure of:

address{
        line1: 4191 Ridgebrook Way,
        city: San Jose,
        state: California
        }

and an XDM structure of:

addr{
    addrLine1: 4191 Ridgebrook Way,
    city: San Jose,
    state: California
    }

Then the mapping becomes:

address -> addr
address.line1 -> addr.addrLine1

In the example above, the city and state attributes are also ingested automatically at runtime because the address object is mapped to addr. If you were to create a line2 attribute in the XDM structure and your input data also contains a line2 in the address object, then it will also be automatically ingested without any need to manually alter the mapping.

To ensure that the automatic mapping works, the following prerequisites must be met:

Parent-level objects should be mapped;
New attributes must have been created in the XDM schema;
New attributes should have matching names in the source schema and the XDM schema.

If any of the prerequisites are not met, then you must manually map the source schema to the XDM schema using data prep.

Appendix

The following provides additional information on using Data Prep mapping functions

Special characters

The table below outlines a list of reserved characters and their corresponding encoded characters.

Reserved character	Encoded character
space	%20
!	%21
"	%22
#	%23
$	%24
%	%25
&	%26
’	%27
(	%28
)	%29
*	%2A
+	%2B
,	%2C
/	%2F
:	%3A
;	%3B
<	%3C
=	%3D
>	%3E
?	%3F
@	%40
[	%5B
\|	%5C
]	%5D
^	%5E
`	%60
~	%7E

Device field values

The table below outlines a list of device field values and their corresponding descriptions.

Device	Description
Desktop	A Desktop or a Laptop type of device.
Anonymized	An anonymous device. In some cases, these are `useragents` that have been altered by an anonymization software.
Unknown	An unknown device. These are usually `useragents` that contain no information about the device.
Mobile	A mobile device that is yet to be identified. This mobile device can be an eReader, a tablet, a phone, a watch, etc.
Tablet	A mobile device with a large screen (commonly > 7").
Phone	A mobile device with a small screen (commonly < 7").
Watch	A mobile device with a tiny screen (commonly < 2"). These devices normally operate as an additional screen for a phone/tablet type of device.
Augmented Reality	A mobile device with AR capabilities.
Virtual Reality	A mobile device with VR capabilities.
eReader	A device similar to a tablet, but usually with an eInk screen.
Set-top box	A connected device that allows interaction through a TV-sized screen.
TV	A device similar to the Set-top box, but is built into the TV.
Home Appliance	A (usually large) home appliance, like a refrigerator.
Game Console	A fixed gaming system like a Playstation or an XBox.
Handheld Game Console	A mobile gaming system like a Nintendo Switch.
Voice	A voice-driven device like an Amazon Alexa or a Google Home.
Car	A vehicle-based browser.
Robot	Robots that visit a website.
Robot Mobile	Robots that visit a website but indicates that they want to be seen as a Mobile visitor.
Robot Imitator	Robots that visit a website, pretending that are robots like Google, but they are not. Note: In most cases, Robot Imitators are indeed robots.
Cloud	A cloud-based application. These are neither robots nor hackers, but are applications that need to connect. This includes Mastodon servers.
Hacker	This device value is used in case scripting is detected in the `useragent` string.

Code samples

map_get_values

Select to view example

 example = "map_get_values(book_details,\"author\") where input is : {\n" +
        "    \"book_details\":\n" +
        "    {\n" +
        "        \"author\": \"George R. R. Martin\",\n" +
        "        \"price\": 17.99,\n" +
        "        \"ISBN\": \"ISBN-978-0553801477\"\n" +
        "    }\n" +
        "}",
      result = "{\"author\": \"George R. R. Martin\"}"

map_has_keys

Select to view example

 example = "map_has_keys(book_details,\"author\")where input is : {\n" +
        "    \"book_details\":\n" +
        "    {\n" +
        "        \"author\": \"George R. R. Martin\",\n" +
        "        \"price\": 17.99,\n" +
        "        \"ISBN\": \"ISBN-978-0553801477\"\n" +
        "    }\n" +
        "}",
      result = "true"

add_to_map

Select to view example

example = "add_to_map(book_details, book_details2) where input is {\n" +
        "    \"book_details\":\n" +
        "    {\n" +
        "        \"author\": \"George R. R. Martin\",\n" +
        "        \"price\": 17.99,\n" +
        "        \"ISBN\": \"ISBN-978-0553801477\"\n" +
        "    }\n" +
        "}" +
        "{\n" +
        "    \"book_details2\":\n" +
        "    {\n" +
        "        \"author\": \"Neil Gaiman\",\n" +
        "        \"price\": 17.99,\n" +
        "        \"ISBN\": \"ISBN-0-380-97365-0\"\n" +
        "        \"publisher\": \"William Morrow\"\n" +
        "    }\n" +
        "}",
      result = "{\n" +
        "    \"book_details\":\n" +
        "    {\n" +
        "        \"author\": \"George R. R. Martin\",\n" +
        "        \"price\": 17.99,\n" +
        "        \"ISBN\": \"ISBN-978-0553801477\"\n" +
        "        \"publisher\": \"William Morrow\"\n" +
        "    }\n" +
        "}",
      returns = "A new map with all elements from map and addends"

object_to_map

Syntax 1

Select to view example

example = "object_to_map(\"firstName\", \"John\", \"lastName\", \"Doe\")",
result = "{\"firstName\" : \"John\", \"lastName\": \"Doe\"}"

Syntax 2

Select to view example

example = "object_to_map(address) where input is " +
  "address: {line1 : \"345 park ave\",line2: \"bldg 2\",City : \"san jose\",State : \"CA\",type: \"office\"}",
result = "{line1 : \"345 park ave\",line2: \"bldg 2\",City : \"san jose\",State : \"CA\",type: \"office\"}"

Syntax 3

Select to view example

example = "object_to_map(addresses,type)" +
        "\n" +
        "[\n" +
        "    {\n" +
        "        \"line1\": \"345 park ave\",\n" +
        "        \"line2\": \"bldg 2\",\n" +
        "        \"City\": \"san jose\",\n" +
        "        \"State\": \"CA\",\n" +
        "        \"type\": \"home\"\n" +
        "    },\n" +
        "    {\n" +
        "        \"line1\": \"345 park ave\",\n" +
        "        \"line2\": \"bldg 2\",\n" +
        "        \"City \": \"san jose\",\n" +
        "        \"State\": \"CA\",\n" +
        "        \"type\": \"work\"\n" +
        "    },\n" +
        "    {\n" +
        "        \"line1\": \"345 park ave\",\n" +
        "        \"line2\": \"bldg 2\",\n" +
        "        \"City \": \"san jose\",\n" +
        "        \"State\": \"CA\",\n" +
        "        \"type\": \"office\"\n" +
        "    }\n" +
        "]" ,
result = "{\n" +
        "    \"home\":\n" +
        "    {\n" +
        "        \"line1\": \"345 park ave\",\n" +
        "        \"line2\": \"bldg 2\",\n" +
        "        \"City\": \"san jose\",\n" +
        "        \"State\": \"CA\",\n" +
        "        \"type\": \"home\"\n" +
        "    },\n" +
        "    \"work\":\n" +
        "    {\n" +
        "        \"line1\": \"345 park ave\",\n" +
        "        \"line2\": \"bldg 2\",\n" +
        "        \"City \": \"san jose\",\n" +
        "        \"State\": \"CA\",\n" +
        "        \"type\": \"work\"\n" +
        "    },\n" +
        "    \"office\":\n" +
        "    {\n" +
        "        \"line1\": \"345 park ave\",\n" +
        "        \"line2\": \"bldg 2\",\n" +
        "        \"City \": \"san jose\",\n" +
        "        \"State\": \"CA\",\n" +
        "        \"type\": \"office\"\n" +
        "    }\n" +
        "}"

array_to_map

Select to view example

example = "array_to_map(addresses, \"type\") where addresses is\n" +
  "\n" +
  "[\n" +
  "    {\n" +
  "        \"line1\": \"345 park ave\",\n" +
  "        \"line2\": \"bldg 2\",\n" +
  "        \"City\": \"san jose\",\n" +
  "        \"State\": \"CA\",\n" +
  "        \"type\": \"home\"\n" +
  "    },\n" +
  "    {\n" +
  "        \"line1\": \"345 park ave\",\n" +
  "        \"line2\": \"bldg 2\",\n" +
  "        \"City \": \"san jose\",\n" +
  "        \"State\": \"CA\",\n" +
  "        \"type\": \"work\"\n" +
  "    },\n" +
  "    {\n" +
  "        \"line1\": \"345 park ave\",\n" +
  "        \"line2\": \"bldg 2\",\n" +
  "        \"City \": \"san jose\",\n" +
  "        \"State\": \"CA\",\n" +
  "        \"type\": \"office\"\n" +
  "    }\n" +
  "]" ,
result = "{\n" +
  "    \"home\":\n" +
  "    {\n" +
  "        \"line1\": \"345 park ave\",\n" +
  "        \"line2\": \"bldg 2\",\n" +
  "        \"City\": \"san jose\",\n" +
  "        \"State\": \"CA\",\n" +
  "        \"type\": \"home\"\n" +
  "    },\n" +
  "    \"work\":\n" +
  "    {\n" +
  "        \"line1\": \"345 park ave\",\n" +
  "        \"line2\": \"bldg 2\",\n" +
  "        \"City \": \"san jose\",\n" +
  "        \"State\": \"CA\",\n" +
  "        \"type\": \"work\"\n" +
  "    },\n" +
  "    \"office\":\n" +
  "    {\n" +
  "        \"line1\": \"345 park ave\",\n" +
  "        \"line2\": \"bldg 2\",\n" +
  "        \"City \": \"san jose\",\n" +
  "        \"State\": \"CA\",\n" +
  "        \"type\": \"office\"\n" +
  "    }\n" +
  "}",
returns = "Returns a map with given field name and value pairs or null if input is null"

Data Prep mapping functions

Fields

List of functions

String functions

Regular expression functions

Hashing functions

URL functions

Date and time functions

Hierarchies - Objects

Hierarchies - Arrays

Hierarchies - Map

Logical operators

Aggregation

Type conversions

JSON functions

Special operations

User agent functions

Analytics functions

Object copy

Appendix

Special characters

Device field values

Code samples

map_get_values

map_has_keys

add_to_map

object_to_map

array_to_map

More help on this topic

Experience Platform

Top Tips to Maximize Value with Adobe Experience Platform Data Distiller

Wed, Mar 19, 3:30 PM PDT (10:30 PM UTC)

Elevate and Empower Teams with Agentic AI for Exceptional Experiences

Tue, Mar 18, 1:00 PM PDT (8:00 PM UTC)

Connect with Experience League at Summit!