Skip to content

Metrics

Current ETCD recording rules, raw metric sources, and historical scrape samples.

This page separates raw metrics from scrape endpoints from recorded metrics computed by vmalert. As of 2026-10-13, files/victoria/rules/etcd.yml defines 9 recording rules. The table lists each name and expression. Recorded metrics come from rule evaluation and are not found at an exporter’s /metrics endpoint.

Raw metrics vary with software versions, collectors, privileges, instance roles, and runtime state. Historical scrape samples are retained for identifying metrics, not as a complete interface for the current version.

Current Recording Rules

Expressions retain their source semantics. ins, cls, and env generally indicate instance, cluster, and environment aggregation levels; actual retained labels depend on by / without and vector-matching clauses. Recording rules have no independent Prometheus TYPE metadata and should not all be labeled Counter or Gauge.

Recorded MetricExpression
etcd:ins:rpmsum without (type, client_api_version) (increase(etcd_server_client_requests_total{job="etcd"}[1m]))
etcd:ins:wpmincrease(etcd_server_proposals_committed_total{job="etcd"}[1m])
etcd:ins:quota_usageetcd_mvcc_db_total_size_in_bytes{job="etcd"} / etcd_server_quota_backend_bytes{job="etcd"}
etcd:cls:quota_usagemax by (job,cls) (etcd_mvcc_db_total_size_in_bytes{job="etcd"} / etcd_server_quota_backend_bytes{job="etcd"})
etcd:ins:ageetcd_debugging_mvcc_current_revision{job="etcd"} - etcd_debugging_mvcc_compact_revision{job="etcd"}
etcd:cls:agemax by (job,cls) (etcd_debugging_mvcc_current_revision{job="etcd"} - etcd_debugging_mvcc_compact_revision{job="etcd"})
etcd:ins:wal_fsync_rt_p95_5mhistogram_quantile(0.95, rate(etcd_disk_wal_fsync_duration_seconds_bucket{job="etcd"}[5m]))
etcd:ins:backend_commit_rt_p95_5mhistogram_quantile(0.95, rate(etcd_disk_backend_commit_duration_seconds_bucket{job="etcd"}[5m]))
etcd:ins:network_peer_rt_p95_5mhistogram_quantile(0.95, rate(etcd_network_peer_round_trip_time_seconds_bucket{job="etcd"}[5m]))

In addition, etcd_up come from Infra’s shared liveness recording rules. They are excluded from the module rule count above and are not raw exporter metrics. They reflect scrape status and do not replace functional service checks.

Historical Scrape Sample

The existing sample below retains 173 metric names, with recording-rule and alert-state series removed. Its scrape time and software versions were not recorded, so types and labels are for reference only. Unknown indicates missing type metadata. up and scrape_* are generated by the collection system, not the exporter. Histogram / Summary sample names occupy separate rows; row counts are not metric-family counts.

Metric NameTypeLabelsDescription
etcd_cluster_versiongaugecls, cluster_version, ins, instance, job, ipWhich version is running. 1 for ‘cluster_version’ label with current cluster version
etcd_debugging_auth_revisiongaugecls, ins, instance, job, ipThe current revision of auth store.
etcd_debugging_disk_backend_commit_rebalance_duration_seconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_debugging_disk_backend_commit_rebalance_duration_seconds_countUnknowncls, ins, instance, job, ipN/A
etcd_debugging_disk_backend_commit_rebalance_duration_seconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_debugging_disk_backend_commit_spill_duration_seconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_debugging_disk_backend_commit_spill_duration_seconds_countUnknowncls, ins, instance, job, ipN/A
etcd_debugging_disk_backend_commit_spill_duration_seconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_debugging_disk_backend_commit_write_duration_seconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_debugging_disk_backend_commit_write_duration_seconds_countUnknowncls, ins, instance, job, ipN/A
etcd_debugging_disk_backend_commit_write_duration_seconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_debugging_lease_granted_totalcountercls, ins, instance, job, ipThe total number of granted leases.
etcd_debugging_lease_renewed_totalcountercls, ins, instance, job, ipThe number of renewed leases seen by the leader.
etcd_debugging_lease_revoked_totalcountercls, ins, instance, job, ipThe total number of revoked leases.
etcd_debugging_lease_ttl_total_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_debugging_lease_ttl_total_countUnknowncls, ins, instance, job, ipN/A
etcd_debugging_lease_ttl_total_sumUnknowncls, ins, instance, job, ipN/A
etcd_debugging_mvcc_compact_revisiongaugecls, ins, instance, job, ipThe revision of the last compaction in store.
etcd_debugging_mvcc_current_revisiongaugecls, ins, instance, job, ipThe current revision of store.
etcd_debugging_mvcc_db_compaction_keys_totalcountercls, ins, instance, job, ipTotal number of db keys compacted.
etcd_debugging_mvcc_db_compaction_lastgaugecls, ins, instance, job, ipThe unix time of the last db compaction. Resets to 0 on start.
etcd_debugging_mvcc_db_compaction_pause_duration_milliseconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_debugging_mvcc_db_compaction_pause_duration_milliseconds_countUnknowncls, ins, instance, job, ipN/A
etcd_debugging_mvcc_db_compaction_pause_duration_milliseconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_debugging_mvcc_db_compaction_total_duration_milliseconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_debugging_mvcc_db_compaction_total_duration_milliseconds_countUnknowncls, ins, instance, job, ipN/A
etcd_debugging_mvcc_db_compaction_total_duration_milliseconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_debugging_mvcc_events_totalcountercls, ins, instance, job, ipTotal number of events sent by this member.
etcd_debugging_mvcc_index_compaction_pause_duration_milliseconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_debugging_mvcc_index_compaction_pause_duration_milliseconds_countUnknowncls, ins, instance, job, ipN/A
etcd_debugging_mvcc_index_compaction_pause_duration_milliseconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_debugging_mvcc_keys_totalgaugecls, ins, instance, job, ipTotal number of keys.
etcd_debugging_mvcc_pending_events_totalgaugecls, ins, instance, job, ipTotal number of pending events to be sent.
etcd_debugging_mvcc_range_totalcountercls, ins, instance, job, ipTotal number of ranges seen by this member.
etcd_debugging_mvcc_slow_watcher_totalgaugecls, ins, instance, job, ipTotal number of unsynced slow watchers.
etcd_debugging_mvcc_total_put_size_in_bytesgaugecls, ins, instance, job, ipThe total size of put kv pairs seen by this member.
etcd_debugging_mvcc_watch_stream_totalgaugecls, ins, instance, job, ipTotal number of watch streams.
etcd_debugging_mvcc_watcher_totalgaugecls, ins, instance, job, ipTotal number of watchers.
etcd_debugging_server_lease_expired_totalcountercls, ins, instance, job, ipThe total number of expired leases.
etcd_debugging_snap_save_marshalling_duration_seconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_debugging_snap_save_marshalling_duration_seconds_countUnknowncls, ins, instance, job, ipN/A
etcd_debugging_snap_save_marshalling_duration_seconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_debugging_snap_save_total_duration_seconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_debugging_snap_save_total_duration_seconds_countUnknowncls, ins, instance, job, ipN/A
etcd_debugging_snap_save_total_duration_seconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_debugging_store_expires_totalcountercls, ins, instance, job, ipTotal number of expired keys.
etcd_debugging_store_reads_totalcountercls, action, ins, instance, job, ipTotal number of reads action by (get/getRecursive), local to this member.
etcd_debugging_store_watch_requests_totalcountercls, ins, instance, job, ipTotal number of incoming watch requests (new or reestablished).
etcd_debugging_store_watchersgaugecls, ins, instance, job, ipCount of currently active watchers.
etcd_debugging_store_writes_totalcountercls, action, ins, instance, job, ipTotal number of writes (e.g. set/compareAndDelete) seen by this member.
etcd_disk_backend_commit_duration_seconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_disk_backend_commit_duration_seconds_countUnknowncls, ins, instance, job, ipN/A
etcd_disk_backend_commit_duration_seconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_disk_backend_defrag_duration_seconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_disk_backend_defrag_duration_seconds_countUnknowncls, ins, instance, job, ipN/A
etcd_disk_backend_defrag_duration_seconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_disk_backend_snapshot_duration_seconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_disk_backend_snapshot_duration_seconds_countUnknowncls, ins, instance, job, ipN/A
etcd_disk_backend_snapshot_duration_seconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_disk_defrag_inflightgaugecls, ins, instance, job, ipWhether or not defrag is active on the member. 1 means active, 0 means not.
etcd_disk_wal_fsync_duration_seconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_disk_wal_fsync_duration_seconds_countUnknowncls, ins, instance, job, ipN/A
etcd_disk_wal_fsync_duration_seconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_disk_wal_write_bytes_totalgaugecls, ins, instance, job, ipTotal number of bytes written in WAL.
etcd_grpc_proxy_cache_hits_totalgaugecls, ins, instance, job, ipTotal number of cache hits
etcd_grpc_proxy_cache_keys_totalgaugecls, ins, instance, job, ipTotal number of keys/ranges cached
etcd_grpc_proxy_cache_misses_totalgaugecls, ins, instance, job, ipTotal number of cache misses
etcd_grpc_proxy_events_coalescing_totalcountercls, ins, instance, job, ipTotal number of events coalescing
etcd_grpc_proxy_watchers_coalescing_totalgaugecls, ins, instance, job, ipTotal number of current watchers coalescing
etcd_mvcc_db_open_read_transactionsgaugecls, ins, instance, job, ipThe number of currently open read transactions
etcd_mvcc_db_total_size_in_bytesgaugecls, ins, instance, job, ipTotal size of the underlying database physically allocated in bytes.
etcd_mvcc_db_total_size_in_use_in_bytesgaugecls, ins, instance, job, ipTotal size of the underlying database logically in use in bytes.
etcd_mvcc_delete_totalcountercls, ins, instance, job, ipTotal number of deletes seen by this member.
etcd_mvcc_hash_duration_seconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_mvcc_hash_duration_seconds_countUnknowncls, ins, instance, job, ipN/A
etcd_mvcc_hash_duration_seconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_mvcc_hash_rev_duration_seconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_mvcc_hash_rev_duration_seconds_countUnknowncls, ins, instance, job, ipN/A
etcd_mvcc_hash_rev_duration_seconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_mvcc_put_totalcountercls, ins, instance, job, ipTotal number of puts seen by this member.
etcd_mvcc_range_totalcountercls, ins, instance, job, ipTotal number of ranges seen by this member.
etcd_mvcc_txn_totalcountercls, ins, instance, job, ipTotal number of txns seen by this member.
etcd_network_active_peersgaugecls, ins, Local, instance, job, ip, RemoteThe current number of active peer connections.
etcd_network_client_grpc_received_bytes_totalcountercls, ins, instance, job, ipThe total number of bytes received from grpc clients.
etcd_network_client_grpc_sent_bytes_totalcountercls, ins, instance, job, ipThe total number of bytes sent to grpc clients.
etcd_network_peer_received_bytes_totalcountercls, ins, instance, job, ip, FromThe total number of bytes received from peers.
etcd_network_peer_round_trip_time_seconds_bucketUnknowncls, To, ins, instance, job, le, ipN/A
etcd_network_peer_round_trip_time_seconds_countUnknowncls, To, ins, instance, job, ipN/A
etcd_network_peer_round_trip_time_seconds_sumUnknowncls, To, ins, instance, job, ipN/A
etcd_network_peer_sent_bytes_totalcountercls, To, ins, instance, job, ipThe total number of bytes sent to peers.
etcd_server_apply_duration_seconds_bucketUnknowncls, version, ins, instance, job, le, success, ip, opN/A
etcd_server_apply_duration_seconds_countUnknowncls, version, ins, instance, job, success, ip, opN/A
etcd_server_apply_duration_seconds_sumUnknowncls, version, ins, instance, job, success, ip, opN/A
etcd_server_client_requests_totalcounterclient_api_version, cls, ins, instance, type, job, ipThe total number of client requests per client version.
etcd_server_go_versiongaugecls, ins, instance, job, server_go_version, ipWhich Go version server is running with. 1 for ‘server_go_version’ label with current version.
etcd_server_has_leadergaugecls, ins, instance, job, ipWhether or not a leader exists. 1 is existence, 0 is not.
etcd_server_health_failurescountercls, ins, instance, job, ipThe total number of failed health checks
etcd_server_health_successcountercls, ins, instance, job, ipThe total number of successful health checks
etcd_server_heartbeat_send_failures_totalcountercls, ins, instance, job, ipThe total number of leader heartbeat send failures (likely overloaded from slow disk).
etcd_server_idgaugecls, ins, instance, job, server_id, ipServer or member ID in hexadecimal format. 1 for ‘server_id’ label with current ID.
etcd_server_is_leadergaugecls, ins, instance, job, ipWhether or not this member is a leader. 1 if is, 0 otherwise.
etcd_server_is_learnergaugecls, ins, instance, job, ipWhether or not this member is a learner. 1 if is, 0 otherwise.
etcd_server_leader_changes_seen_totalcountercls, ins, instance, job, ipThe number of leader changes seen.
etcd_server_learner_promote_successescountercls, ins, instance, job, ipThe total number of successful learner promotions while this member is leader.
etcd_server_proposals_applied_totalgaugecls, ins, instance, job, ipThe total number of consensus proposals applied.
etcd_server_proposals_committed_totalgaugecls, ins, instance, job, ipThe total number of consensus proposals committed.
etcd_server_proposals_failed_totalcountercls, ins, instance, job, ipThe total number of failed proposals seen.
etcd_server_proposals_pendinggaugecls, ins, instance, job, ipThe current number of pending proposals to commit.
etcd_server_quota_backend_bytesgaugecls, ins, instance, job, ipCurrent backend storage quota size in bytes.
etcd_server_read_indexes_failed_totalcountercls, ins, instance, job, ipThe total number of failed read indexes seen.
etcd_server_slow_apply_totalcountercls, ins, instance, job, ipThe total number of slow apply requests (likely overloaded from slow disk).
etcd_server_slow_read_indexes_totalcountercls, ins, instance, job, ipThe total number of pending read indexes not in sync with leader’s or timed out read index requests.
etcd_server_snapshot_apply_in_progress_totalgaugecls, ins, instance, job, ip1 if the server is applying the incoming snapshot. 0 if none.
etcd_server_versiongaugecls, server_version, ins, instance, job, ipWhich version is running. 1 for ‘server_version’ label with current version.
etcd_snap_db_fsync_duration_seconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_snap_db_fsync_duration_seconds_countUnknowncls, ins, instance, job, ipN/A
etcd_snap_db_fsync_duration_seconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_snap_db_save_total_duration_seconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_snap_db_save_total_duration_seconds_countUnknowncls, ins, instance, job, ipN/A
etcd_snap_db_save_total_duration_seconds_sumUnknowncls, ins, instance, job, ipN/A
etcd_snap_fsync_duration_seconds_bucketUnknowncls, ins, instance, job, le, ipN/A
etcd_snap_fsync_duration_seconds_countUnknowncls, ins, instance, job, ipN/A
etcd_snap_fsync_duration_seconds_sumUnknowncls, ins, instance, job, ipN/A
go_gc_duration_secondssummarycls, ins, instance, quantile, job, ipA summary of the pause duration of garbage collection cycles.
go_gc_duration_seconds_countUnknowncls, ins, instance, job, ipN/A
go_gc_duration_seconds_sumUnknowncls, ins, instance, job, ipN/A
go_goroutinesgaugecls, ins, instance, job, ipNumber of goroutines that currently exist.
go_infogaugecls, version, ins, instance, job, ipInformation about the Go environment.
go_memstats_alloc_bytesgaugecls, ins, instance, job, ipNumber of bytes allocated and still in use.
go_memstats_alloc_bytes_totalcountercls, ins, instance, job, ipTotal number of bytes allocated, even if freed.
go_memstats_buck_hash_sys_bytesgaugecls, ins, instance, job, ipNumber of bytes used by the profiling bucket hash table.
go_memstats_frees_totalcountercls, ins, instance, job, ipTotal number of frees.
go_memstats_gc_cpu_fractiongaugecls, ins, instance, job, ipThe fraction of this program’s available CPU time used by the GC since the program started.
go_memstats_gc_sys_bytesgaugecls, ins, instance, job, ipNumber of bytes used for garbage collection system metadata.
go_memstats_heap_alloc_bytesgaugecls, ins, instance, job, ipNumber of heap bytes allocated and still in use.
go_memstats_heap_idle_bytesgaugecls, ins, instance, job, ipNumber of heap bytes waiting to be used.
go_memstats_heap_inuse_bytesgaugecls, ins, instance, job, ipNumber of heap bytes that are in use.
go_memstats_heap_objectsgaugecls, ins, instance, job, ipNumber of allocated objects.
go_memstats_heap_released_bytesgaugecls, ins, instance, job, ipNumber of heap bytes released to OS.
go_memstats_heap_sys_bytesgaugecls, ins, instance, job, ipNumber of heap bytes obtained from system.
go_memstats_last_gc_time_secondsgaugecls, ins, instance, job, ipNumber of seconds since 1970 of last garbage collection.
go_memstats_lookups_totalcountercls, ins, instance, job, ipTotal number of pointer lookups.
go_memstats_mallocs_totalcountercls, ins, instance, job, ipTotal number of mallocs.
go_memstats_mcache_inuse_bytesgaugecls, ins, instance, job, ipNumber of bytes in use by mcache structures.
go_memstats_mcache_sys_bytesgaugecls, ins, instance, job, ipNumber of bytes used for mcache structures obtained from system.
go_memstats_mspan_inuse_bytesgaugecls, ins, instance, job, ipNumber of bytes in use by mspan structures.
go_memstats_mspan_sys_bytesgaugecls, ins, instance, job, ipNumber of bytes used for mspan structures obtained from system.
go_memstats_next_gc_bytesgaugecls, ins, instance, job, ipNumber of heap bytes when next garbage collection will take place.
go_memstats_other_sys_bytesgaugecls, ins, instance, job, ipNumber of bytes used for other system allocations.
go_memstats_stack_inuse_bytesgaugecls, ins, instance, job, ipNumber of bytes in use by the stack allocator.
go_memstats_stack_sys_bytesgaugecls, ins, instance, job, ipNumber of bytes obtained from system for stack allocator.
go_memstats_sys_bytesgaugecls, ins, instance, job, ipNumber of bytes obtained from system.
go_threadsgaugecls, ins, instance, job, ipNumber of OS threads created.
grpc_server_handled_totalcountercls, ins, instance, grpc_code, job, grpc_method, grpc_type, ip, grpc_serviceTotal number of RPCs completed on the server, regardless of success or failure.
grpc_server_msg_received_totalcountercls, ins, instance, job, grpc_type, grpc_method, ip, grpc_serviceTotal number of RPC stream messages received on the server.
grpc_server_msg_sent_totalcountercls, ins, instance, job, grpc_type, grpc_method, ip, grpc_serviceTotal number of gRPC stream messages sent by the server.
grpc_server_started_totalcountercls, ins, instance, job, grpc_type, grpc_method, ip, grpc_serviceTotal number of RPCs started on the server.
os_fd_limitgaugecls, ins, instance, job, ipThe file descriptor limit.
os_fd_usedgaugecls, ins, instance, job, ipThe number of used file descriptors.
process_cpu_seconds_totalcountercls, ins, instance, job, ipTotal user and system CPU time spent in seconds.
process_max_fdsgaugecls, ins, instance, job, ipMaximum number of open file descriptors.
process_open_fdsgaugecls, ins, instance, job, ipNumber of open file descriptors.
process_resident_memory_bytesgaugecls, ins, instance, job, ipResident memory size in bytes.
process_start_time_secondsgaugecls, ins, instance, job, ipStart time of the process since unix epoch in seconds.
process_virtual_memory_bytesgaugecls, ins, instance, job, ipVirtual memory size in bytes.
process_virtual_memory_max_bytesgaugecls, ins, instance, job, ipMaximum amount of virtual memory available in bytes.
promhttp_metric_handler_requests_in_flightgaugecls, ins, instance, job, ipCurrent number of scrapes being served.
promhttp_metric_handler_requests_totalcountercls, ins, instance, job, ip, codeTotal number of scrapes by HTTP status code.
scrape_duration_secondsUnknowncls, ins, instance, job, ipN/A
scrape_samples_post_metric_relabelingUnknowncls, ins, instance, job, ipN/A
scrape_samples_scrapedUnknowncls, ins, instance, job, ipN/A
scrape_series_addedUnknowncls, ins, instance, job, ipN/A
upUnknowncls, ins, instance, job, ipN/A

Was this page helpful?

Last Modified 2026-10-26 · docs: sync reviewed Chinese application and operations guidance (f9613ee7)