Google Cloud Monitoring Metrics

Key
Metric Type Display Name

Kind, Type, Unit	Description
	Labels

🚧
Metric prefixes
All metrics listed below are prefixed with external.googleapis.com/bluemedora/generic_node/kafka except for the metrics that are also listed in the associated Stackdriver Agent Migration page. If the collector is installed on the Kafka host system, the metrics listed there will be prefixed with agent.googleapis.com/kafka

Google Cloud Monitoring Metrics

`/controller/kafka/active` Active controllers

GAUGE, DOUBLE, n/a	The number of active controllers in the cluster.





`/broker/cpu/process_load` CPU Process Load

GAUGE, DOUBLE, %	CPU load from the Kafka processes.





`/broker/cpu/system_load` CPU System Load

GAUGE, DOUBLE, %	CPU load of the server.





`/broker/error_count` Error Count

CUMULATIVE, INT64, Errors	Number of errors in responses.





`/broker/incoming_bytes` Incoming Bytes

CUMULATIVE, INT64, By	Total number of incoming bytes.
	source_type: Outgoing data destination ('broker', 'client').




`/broker/topics/incoming_message_count` Incoming messages

CUMULATIVE, INT64, n/a	The number of incoming messages in all topics.





`/replica_manager/isr/expand_count` Gaining replicas

CUMULATIVE, INT64, n/a	The number of replicas catching up (ISR = in-sync replica).





`/replica_manager/isr/shrink_count` Lagging replicas

CUMULATIVE, INT64, n/a	The number of replicas lagging behind (ISR = in-sync replica).





`/controller/leader_elections/election_count` Leader elections

CUMULATIVE, INT64, n/a	The total number of leader elections.





`/controller/leader_elections/unclean_count` Stale leader elections

CUMULATIVE, INT64, n/a	The total number of leader elections where the leader is out-of-sync.





`/replica_manager/leaders` Leaders

GAUGE, DOUBLE, n/a	The current number of leaders on this broker.





`/log/flush_count` Flushes

CUMULATIVE, INT64, n/a	The number of log flushes.





`/broker/memory/free_bytes` Memory Free Bytes

GAUGE, INT64, By	Free memory on the server.





`/broker/memory/size_bytes` Memory Size Bytes

GAUGE, INT64, By	Total memory of the server.





`/broker/memory/temporary_bytes` Memory Temporary Bytes

GAUGE, INT64, By	Temporary memory used for message format conversions and decompression





`/broker/memory/utilization` Memory Utilization

GAUGE, DOUBLE, %	Memory utilization of the server.





`/broker/message_conversion_count` Message Conversion Count

CUMULATIVE, INT64, n/a	Number of records which required message format conversion.





`/broker/message_conversion_time` Message Conversation Time

GAUGE, DOUBLE, ms	Time in milliseconds spent on message format conversions.





`/controller/kafka/offline_partitions` Offline partitions

GAUGE, DOUBLE, n/a	The number of partitions that don’t have an active leader and are hence not writable or readable.





`/broker/outgoing_bytes` Outgoing Bytes

CUMULATIVE, INT64, By	Total number of bytes outgoing to other systems.
	source_type: Outgoing data destination ('broker', 'client').




`/replica_manager/partitions` Partitions

GAUGE, DOUBLE, n/a	The current number of partitions on this broker.





`/purgatory/num_delayed_requests` Delayed purgatory requests

GAUGE, DOUBLE, Requests	The current number of delayed requests in purgatory.
	request_type: The type of request (fetch or produce).




`/purgatory/size` Purgatory requests

GAUGE, DOUBLE, Requests	The current number of requests in purgatory.
	request_type: The type of the request, fetch or produce.




`/replica_fetcher/max_lag` Maximum lag

GAUGE, DOUBLE, n/a	The maximum lag in messages between the follower and leader replicas.





`/replica_fetcher/min_fetch_rate` Minimum fetch rate

GAUGE, DOUBLE, 1/s	The minimum rate at which the follower replicas send fetch requests to the leaders.





`/network/request_count` Requests

CUMULATIVE, INT64, Requests	The number of requests.
	request_type: The type of request (fetch or produce).




`/broker/topics/failed_request_count` Failed requests

CUMULATIVE, INT64, Requests	The number of failed requests.
	request_type: The type of request (fetch or produce).




`/broker/topics/traffic` Traffic

CUMULATIVE, INT64, By	The number of bytes sent and received in all topics.
	direction: Data direction, in or out.




`/replica_manager/under_replicated_partitions` Unreliable partitions

GAUGE, DOUBLE, n/a	The current number of under-replicated partitions.





`/cluster/broker_count` Broker Count

GAUGE, INT64, n/a	Number of brokers.





`/cluster/consumer_count` Consumer Count

GAUGE, INT64, n/a	Number of consumers.





`/cluster/producer_count` Producer Count

GAUGE, INT64, n/a	Number of producers.





`/consumer/assigned_partition_count` Assigned Partition Count

GAUGE, INT64, n/a	Number of assigned partitions.





`/consumer/average_commit_latency` Average Commit Latency

GAUGE, DOUBLE, ns	Average time taken for a commit request.





`/consumer/average_join_time` Average Join Time

GAUGE, DOUBLE, ns	Average time taken for a group rejoin.





`/consumer/average_sync_time` Average Sync Time

GAUGE, DOUBLE, ns	Average time taken for a group sync.





`/consumer/commit_count` Commit Count

CUMULATIVE, INT64, n/a	Total number of commit calls.





`/consumer/connection_close_count` Connection Close Count

CUMULATIVE, INT64, n/a	Total number of connections closed.





`/consumer/connection_count` Connection Count

GAUGE, INT64, n/a	Number of connections.





`/consumer/connection_create_count` Connection Create Count

CUMULATIVE, INT64, n/a	Total number of new connections established.





`/consumer/incoming_bytes` Incoming Bytes

CUMULATIVE, INT64, By	Total number of bytes read off all sockets.





`/consumer/io/time` I/O Time

CUMULATIVE, INT64, ns	Total time the I/O thread spent performing I/O.





`/consumer/io/wait_time` I/O Wait Time

CUMULATIVE, INT64, ns	Total time the I/O thread spent waiting.





`/consumer/io/average_wait_time` Average IO Wait Time

GAUGE, DOUBLE, ns	Average length of time the I/O thread spent waiting for a socket ready for reads or writes.





`/consumer/io/time_ratio` IO Time Ratio

GAUGE, DOUBLE, %	Fraction of time the I/O thread spent doing I/O.





`/consumer/io/wait_time_ratio` IO Wait Time Ratio

GAUGE, DOUBLE, %	Fraction of time the I/O thread spent waiting.





`/consumer/join_count` Join Count

CUMULATIVE, INT64, n/a	Total number of group joins.





`/consumer/maximum_commit_latency` Maximum Commit Latency

GAUGE, DOUBLE, ns	Maximum latency experienced during a commit.





`/consumer/maximum_join_time` Maximum Join Time

GAUGE, DOUBLE, ns	Maximum time spent in a single join.





`/consumer/maximum_lag` Maximum Lag

GAUGE, DOUBLE, Records	The maximum lag in terms of number of records for any partition in this window.





`/consumer/maximum_sync_time` Maximum Sync Time

GAUGE, DOUBLE, ns	Maximum time spent in a single sync.





`/consumer/outgoing_bytes` Outgoing Bytes

CUMULATIVE, INT64, By	Total number of outgoing bytes sent to all servers.





`/consumer/request_count` Request Count

CUMULATIVE, INT64, Requests	Total number of requests sent.





`/consumer/response_count` Response Count

CUMULATIVE, INT64, n/a	Total number of responses received.





`/consumer/sync_count` Sync Count

CUMULATIVE, INT64, n/a	Total number of group syncs.





`/producer/average_request_latency` Average Request Latency

GAUGE, DOUBLE, ns	Average latency of requests.





`/producer/buffer_memory/available_bytes` Buffer Memory Available Bytes

GAUGE, INT64, By	Total amount of buffer memory that is not being used (either unallocated or in the free list).





`/producer/buffer_memory/total_bytes` Buffer Memory Total Bytes

GAUGE, INT64, By	Maximum amount of buffer memory the client can use (whether or not it is currently used).





`/producer/connection_closed_count` Connection Closed Count

CUMULATIVE, INT64, Connections	Total number of connections closed.





`/producer/connection_count` Connection Count

GAUGE, INT64, Connections	Number of connections.





`/producer/connection_created_count` Connection Created Count

CUMULATIVE, INT64, Connections	Total number of new connections established.





`/producer/incoming_bytes` Incoming Bytes

CUMULATIVE, INT64, By	Total number of bytes read off all sockets.





`/producer/io/time` I/O Time

CUMULATIVE, INT64, ns	Total time the I/O thread spent doing I/O.





`/producer/io/wait_time` I/O Wait Time

CUMULATIVE, INT64, ns	Total time the I/O thread spent waiting.





`/producer/io/average_wait_time` Average IO Wait Time

GAUGE, DOUBLE, ns	Average length of time the I/O thread spent waiting for a socket ready for reads or writes.





`/producer/io/time_ratio` IO Time Ratio

GAUGE, DOUBLE, %	Fraction of time the I/O thread spent doing I/O.





`/producer/io/wait_time_ratio` IO Wait Time Ratio

GAUGE, DOUBLE, %	Fraction of time the I/O thread spent waiting.





`/producer/maximum_request_latency` Maximum Request Latency

GAUGE, DOUBLE, ns	Maximum latency experienced by a single request.





`/producer/outgoing_bytes` Outgoing Bytes

CUMULATIVE, INT64, By	Total number of outgoing bytes sent to all servers.





`/producer/record/error_count` Record Error Count

CUMULATIVE, INT64, Errors	Total number of record sends that resulted in errors.





`/producer/record/retry_count` Record Retry Count

CUMULATIVE, INT64, n/a	Total number of retried record sends.





`/producer/record/send_count` Record Send Count

CUMULATIVE, INT64, Records	Total number of records sent.





`/producer/request_count` Request Count

CUMULATIVE, INT64, Requests	Total number of requests sent.





`/producer/response_count` Response Count

CUMULATIVE, INT64, n/a	Total number of responses received.





`/producer/waiting_thread_count` Waiting Thread Count

GAUGE, INT64, Threads	Number of user threads blocked waiting for buffer memory to enqueue their records.

🚧Metric prefixes

🚧
Metric prefixes