Custom Kafka Logs
Collect data from kafka topic with Elastic Agent.
Version | 1.7.0 (View all) |
Compatible Kibana version(s) | 8.13.0 or higher |
Supported Serverless project types | Security Observability |
Subscription level | Basic |
Level of support | Elastic |
The custom Kafka log integration is used to read from topics in a Kafka cluster.
To configure this integration, specify a list of one or more hosts in the cluster to bootstrap the connection with, a list of topics to track, and a group_id for the connection.
Compatibility
This Integration works with all Kafka versions in between 0.11 and 2.8.0. Older versions might work as well, but are not supported.
Ingest Pipelines
Custom ingest pipelines may be added by adding the name to the pipeline configuration option, creating custom ingest pipelines can be done either through the API or the Ingest Node Pipeline UI.
ECS Field Reference
Please refer to the following document for detailed information on ECS fields.
Changelog
Version | Details | Kibana version(s) |
---|---|---|
1.7.0 | Enhancement View pull request | 8.13.0 or higher |
1.6.0 | Enhancement View pull request | 8.12.0 or higher |
1.5.1 | Bug fix View pull request | 7.16.0 or higher |
1.5.0 | Enhancement View pull request | 7.16.0 or higher |
1.4.0 | Enhancement View pull request | 7.16.0 or higher |
1.3.0 | Enhancement View pull request | 7.16.0 or higher |
1.2.0 | Enhancement View pull request | 7.16.0 or higher |
1.1.1 | Enhancement View pull request | 7.16.0 or higher |
1.1.0 | Enhancement View pull request | 7.16.0 or higher |
1.0.0 | Enhancement View pull request | 7.16.0 or higher |