Indexer Metrics

Metric Name Type Components Purpose
hdx_sink_row_count Counter Batch (inc. Autoingest), Kafka, Kinesis, Stream HTTP, Intake Head Count of rows processed by the indexer and uploaded to storage. Includes Hot and Cold reporting.
hdx_sink_byte_count Counter Batch (inc. Autoingest), Kafka, Kinesis, Stream HTTP, Intake Head Count of bytes processed by the indexer and uploaded to storage. Includes Hot and Cold reporting.
hdx_sink_value_count Counter Batch (inc. Autoingest), Kafka, Kinesis, Stream HTTP, Intake Head Count of values processed by the indexer and uploaded to storage. Includes Hot and Cold reporting.
hdx_sink_error_count Counter Batch (inc. Autoingest), Kafka, Kinesis, Stream HTTP, Intake Head Count of errors in indexing and uploading to storage.
indexer_rows_written_count/bucket/sum Histogram Batch (inc. Autoingest), Kafka, Kinesis, Stream HTTP, Intake Head Total rows indexed (written to partitions).
indexer_bytes_written_count/bucket/sum Histogram Batch (inc. Autoingest), Kafka, Kinesis, Stream HTTP, Intake Head Total bytes indexed (written to partitions).
indexer_partitions_rejected_count/bucket/sum Histogram Batch (inc. Autoingest), Kafka, Kinesis, Stream HTTP, Intake Head Histogram of partitions not written. Values: 0 = raw data parsing failed, 1 = raw data or transform schema mismatch, 3 = error writing partition file, 4 = other error during indexing.
indexer_partitions_written_count/bucket/sum Histogram Batch (inc. Autoingest), Kafka, Kinesis, Stream HTTP, Intake Head Total partitions created.
indexer_partition_write_seconds_count/bucket/sum Histogram Batch (inc. Autoingest), Kafka, Kinesis, Stream HTTP, Intake Head Time from receiving indexing query to writing partition file, in seconds.
hdx_partition_bloom_columns_total_count/bucket/sum Histogram Batch (inc. Autoingest), Kafka, Kinesis, Stream HTTP, Intake Head Number of columns whose partitions are written with bloom filters. Useful for monitoring bloom filter coverage. String and uint128 (ip, uuid) columns use partition bloom filters.
hdx_partition_bloom_bytes_total_count/bucket/sum Histogram Batch (inc. Autoingest), Kafka, Kinesis, Stream HTTP, Intake Head Total bloom filter bytes per partition at write time, for monitoring the storage overhead bloom filters add.
hdx_partition_bloom_build_seconds_count/bucket/sum Histogram Batch (inc. Autoingest), Kafka, Kinesis, Stream HTTP, Intake Head Time to build bloom filters per partition at write time, in seconds, for monitoring bloom build cost during indexing.