What is an Elastic integration?

This integration is powered by Elastic Agent. Elastic Agent is a single, unified way to add monitoring for logs, metrics, and other types of data to a host. It can also protect hosts from security threats, query data from operating systems, forward data from remote services or hardware, and more. Refer to our documentation for a detailed comparison between Beats and Elastic Agent.

Prefer to use Beats for this use case? See Filebeat modules for logs or Metricbeat modules for metrics.

Overview

The custom Google Pub/Sub input integration is used to ingest data from a Google Pub/Sub topic subscription that is not covered by our GCP Integration.

This integration could for example be used to receive Stackdriver logs that have been exported to a Google Pub/Sub topic.

Multiple Elastic Agent instances can be configured to read from the same subscription to achieve high-availability or increased throughput.

Configuring

  1. Create a user-managed service account (you can skip this if Elastic Agent is running in a VM with a service account attached). See: Service Accounts

  2. Create a Pub/Sub topic and subscription. See:Topics and Subscriptions

  3. Configure this integration to read from the Pub/Sub subscription using the service account credentials.

  4. Write logs into the Pub/Sub topic yourself or configure a log sink to export GCP logs to the topic. See: Managing Sinks

Changelog

VersionDetails
1.1.0
Enhancement View pull request
Update package to ECS 8.3.0.
1.0.1
Enhancement View pull request
update readme
1.0.0
Enhancement View pull request
Initial Release