Query Tracing

Your Hydrolix stack includes Tempo, an open-source distributed tracing backend. While you run query against Hydrolix, we automatically create a new trace which you can monitor on your stack's Grafana instance using the Explorer view.

Getting traceid

Hydrolix automatically add an HTTP Response header traceparent which is standard from w3c.

An example traceparent traceparent: 00-66e383b02d613fa2dd63f36d1585e5a3-7d44056232c1a29f-01

This trace contains 4 different fields separated by a -:

  • 00 is the version
  • 66e383b02d613fa2dd63f36d1585e5a3 is the trace-id (what you'll need to use in Grafana/Tempo)
  • 7d44056232c1a29f is the parent-id
  • 01 is the trace-flags

Example of full HTTP Response Header from Hydrolix:

HTTP/2 200 
date: Tue, 29 Jun 2021 09:32:06 GMT
content-type: application/json; charset=UTF-8
x-clickhouse-query-id: c4f6aba2-480f-4f67-9d5d-5662e44b45dc
x-clickhouse-format: JSON
x-clickhouse-timezone: UTC
x-hdx-query-stats: exec_time=4271 rows_read=0 bytes_read=0 num_partitions=4 num_peers=2
traceparent: 00-9e94d8306114a074da5393950ff481ac-cace2fb519dc02bb-01

Visualizing Traces

Connect to you Grafana and click on the Explore icon:


In the dropdown menu Select Tempo as datasource:


Now you can enter the traceid you have retrieved from the HTTP Response Header: