KAFKA
9 pagesFAQ
How mature is the current KAFKA module? The v1 baseline provides dynamic KRaft, full-cluster checks, cold start and repair, serial broker admission, and dynamic controller join. It supports retirement of live or dead members and three-command …
How mature is the current KAFKA module? The v1 baseline provides dynamic KRaft, full-cluster checks, cold start and repair, serial broker admission, and dynamic controller join. It supports retirement of live or dead members and three-command …
Metrics
Both metric sources use job=kafka. JMX targets have a role label and collect each JVM’s internal state. Protocol targets lack role and collect logical cluster, topic, partition, and consumer-group state through Kafka protocol. Protocol exporters run …
Both metric sources use job=kafka. JMX targets have a role label and collect each JVM’s internal state. Protocol targets lack role and collect logical cluster, topic, partition, and consumer-group state through Kafka protocol. Protocol exporters run …
Monitoring
Kafka monitoring combines metrics, logs, dashboards, and alerts. It covers JVM internals and the Kafka protocol view. You can inspect partitions, ISR, and consumer lag together with JVM state, request queues, and KRaft controller health. Scrape …
Kafka monitoring combines metrics, logs, dashboards, and alerts. It covers JVM internals and the Kafka protocol view. You can inspect partitions, ISR, and consumer lag together with JVM state, request queues, and KRaft controller health. Scrape …
Playbook
kafka.yml deploys Apache Kafka 4.1+ dynamic KRaft and applies security, resources, and monitoring. kafka-rm.yml removes members or tears down clusters. Cluster Completeness Constraint Each selected kafka_cluster must include every member. Partial …
kafka.yml deploys Apache Kafka 4.1+ dynamic KRaft and applies security, resources, and monitoring. kafka-rm.yml removes members or tears down clusters. Cluster Completeness Constraint Each selected kafka_cluster must include every member. Partial …
Administration
KAFKA installs Kafka in /opt/kafka and manages it with Systemd. Declare persistent settings in pigsty.yml. Do not edit generated node files manually. These CLI examples use the generated /etc/kafka/admin.properties. Keep --command-config even with …
KAFKA installs Kafka in /opt/kafka and manages it with Systemd. Declare persistent settings in pigsty.yml. Do not edit generated node files manually. These CLI examples use the generated /etc/kafka/admin.properties. Keep --command-config even with …
Parameters
Source Version Scope This page follows the current development source snapshot. kafka_jmx_exporter_enabled was added on 2026-09-01. The released v4.5.0 tag does not include it: JMX is always enabled there, and the persistent public parameter count …
Source Version Scope This page follows the current development source snapshot. kafka_jmx_exporter_enabled was added on 2026-09-01. The released v4.5.0 tag does not include it: JMX is always enabled there, and the persistent public parameter count …
Configuration
KAFKA uses 16 persistent public parameters. The role derives topology, listeners, storage subdirectories, replication safety, authorization, and exporter placement consistently. Start with Quickstart. See Parameters for the field reference. Plan …
KAFKA uses 16 persistent public parameters. The role derives topology, listeners, storage subdirectories, replication safety, authorization, and exporter placement consistently. Start with Quickstart. See Parameters for the field reference. Plan …
Quick Start
First build a single-node cluster, create a topic, and read and write messages. Then build a separate secure three-node cluster with users, ACLs, quotas, and production topics. Finally, change parameters, connect clients, verify monitoring, and …
First build a single-node cluster, create a topic, and read and write messages. Then build a separate secure three-node cluster with users, ACLs, quotas, and production topics. Finally, change parameters, connect clients, verify monitoring, and …
Module: KAFKA
Source Version Scope This page follows the current development source snapshot. kafka_jmx_exporter_enabled was added on 2026-09-01. The released v4.5.0 tag does not include it: JMX is always enabled there, and the persistent public parameter count …
Source Version Scope This page follows the current development source snapshot. kafka_jmx_exporter_enabled was added on 2026-09-01. The released v4.5.0 tag does not include it: JMX is always enabled there, and the persistent public parameter count …