This tutorial provides steps for creating a Google PubSub (hereinafter referred to as “PubSub”) using the Platform user interface.
This tutorial requires a working understanding of the following components of Adobe Experience Platform:
If you already have a valid PubSub connection, you may skip the remainder of this document and proceed to the tutorial on configuring a dataflow.
In order to connect PubSub to Platform, you must provide a valid value for the following credentials:
|Project ID||The project ID required to authenticate PubSub.|
|Credentials||The credential or private key ID required to authenticate PubSub.|
|Topic ID||The ID for the PubSub resource that represents a feed of messages. You must specify a topic ID if you want to provide access to a specific stream of data in your Google PubSub source.|
|Subscription ID||The ID of your PubSub subscription. In PubSub, subscriptions allow you to receive messages, by subscribing to the topic in which messages have been published to.|
For more information about these values, see the following PubSub authentication document. If you are using service account-based authentication, see the following PubSub guide for steps on how to generate your credentials.
If you are using service account-based authentication, ensure that you have granted sufficient user access to your service account and that there are no extra white spaces in the JSON, when copying and pasting your credentials.
Once you have gathered your required credentials, you can follow the steps below to link your PubSub account to Platform.
In the Platform UI, select Sources from the left navigation bar to access the Sources workspace. The Catalog screen displays a variety of sources with which you can create an account…
You can select the appropriate category from the catalog on the left-hand side of your screen. Alternatively, you can find the specific source you wish to work with using the search option.
Under the Cloud storage category, select Google PubSub, and then select Add data.
The Connect to Google PubSub page appears. On this page, you can either use new credentials or existing credentials.
To use an existing account, select the PubSub account you want to create a new dataflow with, then select Next to proceed.
If you are creating a new account, select New account, and then provide a name, an optional description, and your PubSub authentication credentials on the input form. During this step, you can define the data that your account has access to by providing a topic ID. Only the subscriptions associated with that topic ID will be accessible.
Principal (roles) assigned to a pubsub project are inherited in all of the topics and subscriptions created inside a PubSub project. If you want to add a principal (role) to have access to a specific topic, then that principal (role) must also be added to the topic’s corresponding subscription as well. For more information, read the PubSub documentation on access control.
When finished, select Connect to source and then allow some time for the new connection to establish.
By following this tutorial, you have create a connection between your PubSub account and Platform. You can now continue on to the next tutorial and configure a dataflow to bring streaming data from your cloud storage into Platform.