Stream Ingest Metrics

Metric Name Type Components Purpose
hdx_sink_backlog_dropped_bytes_count Counter Intake head Total bytes of partition buckets dropped due to backlog growing too big. Only produced when intake_head_index_backlog_enabled is true.
hdx_sink_backlog_dropped_items_count Counter Intake head Count of partition buckets dropped due to backlog growing too big. Only produced when intake_head_index_backlog_enabled is true.
hdx_sink_backlog_delivery_count Counter Intake head Count of backlog buckets successfully handed off to indexing. Only produced when intake_head_index_backlog_enabled is true.
http_source_byte_count Counter Stream head Count of bytes processed.
http_source_request_count Counter Stream head Count of http requests.
http_source_request_error_count Counter Stream head Count of http request failures.
http_source_row_count Counter Stream head Count of rows processed.
http_source_value_count Counter Stream head Count of values processed.
kinesis_source_byte_count Counter Stream peer Count of bytes read from Kinesis.
kinesis_source_checkpoint_count Counter Stream peer Count of Kinesis checkpoint operations.
kinesis_source_checkpoint_error_count Counter Stream peer Count of errors in Kinesis checkpoint operations.
kinesis_source_error_count Counter Stream peer Count of errors in Kinesis source reads.
kinesis_source_operation_count Counter Stream peer Count of operations on Kinesis.
kinesis_source_record_count Counter Stream peer Count of records read from Kinesis.
kinesis_source_row_count Counter Stream peer Count of rows read from Kinesis.
kinesis_source_value_count Counter Stream peer Count of values read from Kinesis.
hdx_sink_backlog_bytes_count Gauge Intake head Total bytes of all partition buckets in sink backlog waiting to be indexed. Only produced when intake_head_index_backlog_enabled is true.
hdx_sink_backlog_items_count Gauge Intake head Total count of partition buckets in sink backlog waiting to be indexed. Only produced when intake_head_index_backlog_enabled is true.
kinesis_source_lag_ms Gauge Stream peer Measure of lag in Kinesis source.
hdx_sink_backlog_trim_duration_ns Histogram Intake head Time to trim the backlog in nanoseconds. Only produced when intake_head_index_backlog_enabled is true.
http_source_request_duration_ns Histogram Stream head A histogram of HTTP request durations in nanoseconds.
kinesis_source_checkpoint_duration_ns Histogram Stream peer Duration of Kinesis checkpoint operations.
kinesis_source_operation_duration_ns Histogram Stream peer Histogram of duration of operations on Kinesis.