Generate output datasets from query results

Query Service allows you to use queries to generate datasets in the Data Lake. These datasets can then be used as input for more queries or in other services such as Data Science Workspace, Real-Time Customer Profile, or Analysis Workspace.

Generate datasets from the Adobe Experience Platform user interface

To create datasets from the Adobe Experience Platform user interface (UI), follow these steps:

  1. Create a query using a connected client and validate the output. To learn how to write queries using Query Editor, read the Query Editor UI guide on writing queries.

  2. In the Platform UI, navigate to Queries followed by the Templates tab and select the query you have created. For more details on how to view queries that were created and saved for your organization within the Platform UI, read the Query Service overview.

  3. In the Query details panel, select Output dataset.

    The Queries workspace Templates tab with Select Output dataset highlighted.

  4. In the dialog that appears, enter a dataset name prepended with your LDAP ID. The dataset name does not have to be unique or SQL-safe. Note that the table name for your dataset will be generated based on the dataset name you create here.

  5. Next, enter a description for your dataset in the Description field and select Run query.

    The Output dataset dialog with the dataset details and run query highlighted

  6. Once the query run is complete, navigate to Datasets to view the dataset you have created. To learn more about how to perform common actions when working with datasets within the Platform UI, see the Datasets UI guide.

After a dataset is created, it can be accessed like any other dataset in the Data Lake and used for a variety of use cases.

NOTE

In a live implementation, you must apply Data Governance labels after the dataset is created. To learn more about how to apply data usage labels to datasets, see the Data usage labels overview.

Generate datasets with a pre-defined Experience Data Model schema

Use the SQL syntax to generate a dataset with a pre-defined Experience Data Model (XDM) schema. For more information about the syntax that is supported by Query Service, please read the SQL Syntax guide.

Output datasets

Datasets created through this functionality are generated with an ad hoc schema that matches the structure of the output data as defined in the SQL statement. Some downstream services require datasets with particular XDM schemas. Verify the data formatting requirements for downstream services prior to writing your queries.

Next steps

After reading this document, you should now understand how to use Query Service to generate datasets from the Platform UI. For more information on how to access, write, and execute queries within the Platform UI, see the Query Service UI overview.

On this page