Hightouch supports streaming events from Google PubSub in realtime.
Simply configure your Google PubSub source in the Hightouch UI, and Hightouch will automatically extract, transform, and load your data into Hightouch Events. Your data can then be synced to your warehouse or streamed to our catalog of realtime destinations.
Hightouch believes in the principle of least privilege. We ask for no more permissions than necessary. For the Google PubSub event source, Hightouch requires roles/pubsub.subscriber and roles/pubsub.viewer. Ensure you run the command in your Google Cloud Console to grant Hightouch's service account the correct permissions.
Hightouch Events supports PubSub messages encoded using Avro and Protobuf as long as a PubSub Schema is configured and associated with the topic. Otherwise, messages need to be encoded as JSON.
All events are ingested into Hightouch as track events. The PubSub message id, data, and attributes are exposed as custom properties on the track event. Metadata such as subscription are also exposed in the context.pubsub object.
You can configure how Hightouch transforms messages from your PubSub topic to Hightouch track events. Mappings can be configured for the following fields:
event
userId
anonymousId
messageId
timestamp
You can also transform your events using Functions in order to standardize the schema or enrich its contents.