Create an Apache Spark on Azure HDInsights source connection in the UI
Source connectors in Adobe Experience Platform provide the ability to ingest externally sourced data on a scheduled basis. This tutorial provides steps for creating an Apache Spark on Azure HDInsights source connector using the Experience Platform user interface.
Getting started
This tutorial requires a working understanding of the following components of Adobe Experience Platform:
-
Experience Data Model (XDM) System: The standardized framework by which Experience Platform organizes customer experience data.
- Basics of schema composition: Learn about the basic building blocks of XDM schemas, including key principles and best practices in schema composition.
- Schema Editor tutorial: Learn how to create custom schemas using the Schema Editor UI.
-
Real-Time Customer Profile: Provides a unified, real-time consumer profile based on aggregated data from multiple sources.
If you already have a valid Spark connection, you may skip the remainder of this document and proceed to the tutorial on configuring a dataflow
Gather required credentials
In order to access your Spark account on Experience Platform, you must provide the following values:
hostusernamepasswordFor more information about getting started, refer to this Spark document.
Connect your Spark account
Once you have gathered your required credentials, you can follow the steps below to link your Spark account to connect to Experience Platform.
Log in to Adobe Experience Platform and then select Sources from the left navigation bar to access the Sources workspace. The Catalog screen displays a variety of sources for which you can create an account with.
You can select the appropriate category from the catalog on the left-hand side of your screen. Alternatively, you can find the specific source you wish to work with using the search option.
Under the Databases category, select Spark. If this is your first time using this connector, select Configure. Otherwise, select Add data to create a new Spark connector.
The Connect to Spark page appears. On this page, you can either use new credentials or existing credentials.
New account
If you are using new credentials, select New account. On the input form that appears, provide a name, an optional description, and your Spark credentials. When finished, select Connect and then allow some time for the new connection to establish.
Existing account
To connect an existing account, select the Spark account you want to connect with, then select Next to proceed.
Next steps
By following this tutorial, you have established a connection to your Spark account. You can now continue on to the next tutorial and configure a dataflow to bring data into Experience Platform.