Create a Google PubSub source connection in the UI

This tutorial provides steps for creating a Google PubSub (hereinafter referred to as “PubSub”) using the Platform user interface.

Getting started

This tutorial requires a working understanding of the following components of Adobe Experience Platform:

  • Sources: Experience Platform allows data to be ingested from various sources while providing you with the ability to structure, label, and enhance incoming data using Platform services.
  • Sandboxes: Experience Platform provides virtual sandboxes which partition a single Platform instance into separate virtual environments to help develop and evolve digital experience applications.

If you already have a valid PubSub connection, you may skip the remainder of this document and proceed to the tutorial on configuring a dataflow.

Gather required credentials

In order to connect PubSub to Platform, you must provide a valid value for the following credentials:

Credential Description
Project ID The project ID required to authenticate PubSub.
Credentials The credential or private key ID required to authenticate PubSub.
Topic ID The ID for the PubSub resource that represents a feed of messages. You must specify a topic ID if you want to provide access to a specific stream of data in your Google PubSub source.
Subscription ID The ID of your PubSub subscription. In PubSub, subscriptions allow you to receive messages, by subscribing to the topic in which messages have been published to.

For more information about these values, see the following PubSub authentication document. If you are using service account-based authentication, see the following PubSub guide for steps on how to generate your credentials.

TIP

If you are using service account-based authentication, ensure that you have granted sufficient user access to your service account and that there are no extra white spaces in the JSON, when copying and pasting your credentials.

Once you have gathered your required credentials, you can follow the steps below to link your PubSub account to Platform.

Connect your PubSub account

In the Platform UI, select Sources from the left navigation bar to access the Sources workspace. The Catalog screen displays a variety of sources with which you can create an account…

You can select the appropriate category from the catalog on the left-hand side of your screen. Alternatively, you can find the specific source you wish to work with using the search option.

Under the Cloud storage category, select Google PubSub, and then select Add data.

The sources catalog on Experience Platform UI.

The Connect to Google PubSub page appears. On this page, you can either use new credentials or existing credentials.

Existing account

To use an existing account, select the PubSub account you want to create a new dataflow with, then select Next to proceed.

The existing account selection in the sources workflow.

New account

If you are creating a new account, select New account, and then provide a name, an optional description, and your PubSub authentication credentials on the input form. During this step, you can define the data that your account has access to by providing a topic ID. Only the subscriptions associated with that topic ID will be accessible.

NOTE

Principal (roles) assigned to a pubsub project are inherited in all of the topics and subscriptions created inside a PubSub project. If you want to add a principal (role) to have access to a specific topic, then that principal (role) must also be added to the topic’s corresponding subscription as well. For more information, read the PubSub documentation on access control.

When finished, select Connect to source and then allow some time for the new connection to establish.

The new account interface in the sources workflow.

Next steps

By following this tutorial, you have create a connection between your PubSub account and Platform. You can now continue on to the next tutorial and configure a dataflow to bring streaming data from your cloud storage into Platform.

On this page