Create an Apache Hive on Azure HDInsights base connection using the Flow Service API
NOTEA base connection represents the authenticated connection between a source and Adobe Experience Platform.
This tutorial walks you through the steps to create a base connection for Apache Hive on Azure HDInsights (hereinafter referred to as “Hive”) using the Flow Service API.
Getting started
This guide requires a working understanding of the following components of Adobe Experience Platform:
- Sources: Experience Platform allows data to be ingested from various sources while providing you with the ability to structure, label, and enhance incoming data using Experience Platform services.
- Sandboxes: Experience Platform provides virtual sandboxes which partition a single Experience Platform instance into separate virtual environments to help develop and evolve digital experience applications.
The following sections provide additional information that you will need to know in order to successfully connect to Hive using the Flow Service API.
Gather required credentials
In order for Flow Service to connect with Hive, you must provide values for the following connection properties:
| Credential | Description |
|---|---|
host | The IP address or host name of the Hive server. |
username | The username that you use to access Hive server. |
password | The password corresponding to the user. |
connectionSpec.id | The connection specification returns a source’s connector properties, including authentication specifications related to creating the base and source connections. The connection specification ID for Hive is: aac9bbd4-6c01-46ce-b47e-51c6f0f6db3f |
For more information about getting started refer to this Hive document.
Using Experience Platform APIs
For information on how to successfully make calls to Experience Platform APIs, see the guide on getting started with Experience Platform APIs.
Create a base connection
A base connection retains information between your source and Experience Platform, including your source’s authentication credentials, the current state of the connection, and your unique base connection ID. The base connection ID allows you to explore and navigate files from within your source and identify the specific items that you want to ingest, including information regarding their data types and formats.
To create a base connection ID, make a POST request to the /connections endpoint while providing your Hive authentication credentials as part of the request parameters.
API format
POST /connections
Request
The following request creates a base connection for Hive:
curl -X POST \
'https://platform.adobe.io/data/foundation/flowservice/connections' \
-H 'Authorization: Bearer {ACCESS_TOKEN}' \
-H 'x-api-key: {API_KEY}' \
-H 'x-gw-ims-org-id: {ORG_ID}' \
-H 'x-sandbox-name: {SANDBOX_NAME}' \
-H 'Content-Type: application/json' \
-d '{
"name": "Apache Hive test connection",
"description": "A test connection for Apache Hive",
"auth": {
"specName": "HDInsights Basic Authentication",
"params": {
"connectionString": "{CONNECTION_STRING}"
}
},
"connectionSpec": {
"id": "aac9bbd4-6c01-46ce-b47e-51c6f0f6db3f",
"version": "1.0"
}
}'
| Parameter | Description |
|---|---|
auth.params.connectionString | The connection string associated with your Hive account. |
connectionSpec.id | The Hive connection specification ID: aac9bbd4-6c01-46ce-b47e-51c6f0f6db3f. |
Response
A successful response returns details of the newly created connection, including its unique identifier (id). This ID is required to explore your data in the next tutorial.
{
"id": "9f6e4311-e032-4c00-ae43-11e032bc00c7",
"etag": "\"f4004fb7-0000-0200-0000-5e865c1e0000\""
}