The Hydrolix stack includes Prometheus, an open-source metrics database. While the Stack runs, Hydrolix continuously updates its Prometheus instance with metrics information. You can query, view, and actively monitor this information through the use of a stack's Grafana instance or you can access it via your own monitoring platform.
Prometheus has its own web-based UI, available by visiting
https://YOUR-HYDROLIX-HOSTNAME.hydrolix.live/prometheus in your web browser.
This view is far more basic than Grafana's, suitable for quickly entering queries and seeing simple, graphed results. Hydrolix does make this feature available immediately, without any additional setup.
|Counter||Decay/Reaper calls to the Catalog.|
|Counter||Decay/Reaper failed Catalog calls.|
|Counter||Latency in calls to catalog.|
|Counter||Latency in calls to catalog.|
Indexer metrics are metrics that cover the indexing and enrichment of data being ingested. These are available across all of the above peer components.
|Histogram||Total rows indexed (written to partitions)|
|Histogram||Total bytes indexed (written to partitions)|
|Histogram||Histogram of partitions not able to written. If value is 0=raw data parsing failed, 1=raw data / transform schema mismatch, 3=Error writing partition file, 4= Other Error during indexing|
|Histogram||Total partitions created|
|Time from receiving indexing query to writing partition file (seconds)|
|Counter||Count of rows processed by the indexer and uploaded to storage. Includes Hot and Cold reporting.|
|Counter||Count of bytes processed by the indexer and uploaded to storage. Includes Hot and Cold reporting.|
|Counter||Count of values processed by the indexer and uploaded to storage. Includes Hot and Cold reporting.|
|Counter||Count of errors in indexing and uploading to storage.|
The following are suggested metrics to monitor your RabbitMQ service
|Counter||Sum of ready and unacknowledged messages (queue depth).|
|Counter||RabbitMQ Queues count.|
|Counter||The total number of bytes received through RabbitMQ ports.|
|Counter||The total number of bytes output through RabbitMQ ports.|
Additional Metrics on can be found on the RabbitMQ Site
Cloud Storage metrics.
|Counter||Batch (inc. Autoingest), Kafka, Kinesis, Stream HTTP||HTTP Status Code histogram count from Storage.|
Additional Metrics are provided for the management and control of different components.
These metrics track various counters and statistics regarding data ingestion.
|Counter||Total user and system CPU time spent in seconds.|
|Gauge||Maximum number of open file descriptors.|
|Gauge||Number of open file descriptors.|
|Gauge||Resident memory size in bytes.|
|Gauge||Start time of the process since unix epoch in seconds.|
|Gauge||Virtual memory size in bytes.|
|Gauge||Maximum amount of virtual memory available in bytes.|
|Gauge||Current number of scrapes being served.|
|Counter||Total number of scrapes by HTTP status code.|
These metrics track resources used by Hydrolix's Go environments.
|Summary||A summary of the pause duration of garbage collection cycles.|
|Gauge||Number of goroutines that currently exist.|
|Gauge||Information about the Go environment.|
|Gauge||Number of bytes allocated and still in use.|
|Counter||Total number of bytes allocated, even if freed.|
|Gauge||Number of bytes used by the profiling bucket hash table.|
|Counter||Total number of frees.|
|Gauge||The fraction of this program's available CPU time used by the GC since the program started.|
|Gauge||Number of bytes used for garbage collection system metadata.|
|Gauge||Number of heap bytes waiting to be used.|
|Gauge||Number of heap bytes that are in use.|
|Gauge||Number of allocated objects.|
|Gauge||Number of heap bytes released to OS.|
|Gauge||Number of heap bytes obtained from system.|
|Gauge||Number of seconds since 1970 of last garbage collection.|
|Counter||Total number of pointer lookups.|
|Counter||Total number of mallocs.|
|Gauge||Number of bytes in use by mcache structures.|
|Gauge||Number of bytes used for mcache structures obtained from system.|
|Gauge||Number of bytes in use by mspan structures.|
|Gauge||Number of bytes used for mspan structures obtained from system.|
|Gauge||Number of heap bytes when next garbage collection will take place.|
|Gauge||Number of bytes used for other system allocations.|
|Gauge||Number of bytes in use by the stack allocator.|
|Gauge||Number of bytes obtained from system for stack allocator.|
|Gauge||Number of bytes obtained from system.|
|Gauge||Number of OS threads created.|
Updated 17 days ago