Component Log Locations
Hydrolix components generate logs. Most of these logs are available in Hydrologs for convenient querying across components. However, you can also find the original, component-specific logs in your cluster's database bucket.
A log-shipping agent collects each pod's container logs and writes them to the database bucket under a /logs/ prefix. Each path follows the pattern /logs/<component>/<container>/<date>/, where <date> is the collection date in YYYY-MM-DD format. The storage locations in this table omit the trailing date directory. For the full logging setup, including how to send logs to other destinations, see Logging Configuration.
To stop Hydrolix from writing these compressed logs to the database bucket, set the disable_vector_bucket_logging tunable to true.
Components that index data into Hydrolix format run a turbine indexer container alongside their main container, so those components have a second log path ending in /turbine/.
| Component | Containers | Storage location (in bucket) |
|---|---|---|
| Alter | alter-head alter-peer turbine |
/logs/alter-head/alter-head/ /logs/alter-peer/alter-peer/ /logs/alter-peer/turbine/ |
| Autoingest | autoingest |
/logs/autoingest/autoingest/ |
| Batch | batch-head batch-peer turbine |
/logs/batch-head/batch-head/ /logs/batch-peer/batch-peer/ /logs/batch-peer/turbine/ |
| Decay | decay |
/logs/decay/decay/ |
| HTTP Ingest | http-head |
/logs/http-head/http-head/ |
| Intake API | intake-api |
/logs/intake-api/intake-api/ |
| Intake Head | intake-head turbine |
/logs/intake-head/intake-head/ /logs/intake-head/turbine/ |
| Intake Peer | intake-peer turbine |
/logs/intake-peer/intake-peer/ /logs/intake-peer/turbine/ |
| Kafka | kafka-peer turbine |
/logs/kafka-peer/kafka-peer/ /logs/kafka-peer/turbine/ |
| Keycloak | keycloak |
/logs/keycloak/keycloak/ |
| Kinesis | kinesis-peer turbine |
/logs/kinesis-peer/kinesis-peer/ /logs/kinesis-peer/turbine/ |
| Merge | merge-peer turbine |
/logs/merge-peer/merge-peer/ /logs/merge-peer/turbine/ |
| Operator | operator |
/logs/operator/operator/ |
| Postgres | postgres |
/logs/postgres/postgres/ |
| Prometheus | prometheus promwaltz |
/logs/prometheus/prometheus/ /logs/prometheus/promwaltz/ |
| Query | query-head query-peer |
/logs/query-head/query-head/ /logs/query-peer/query-peer/ |
| RabbitMQ | rabbitmq |
/logs/rabbitmq/rabbitmq/ |
| Reaper | reaper |
/logs/reaper/reaper/ |
| Stream Summary | summary-peer turbine |
/logs/summary-peer/summary-peer/ /logs/summary-peer/turbine/ |
| Traefik | traefik traefik-cfg hdx-traefik-auth |
/logs/traefik/traefik/ /logs/traefik/traefik-cfg/ /logs/traefik/hdx-traefik-auth/ |
| Turbine API | turbine-api turbine-api-worker |
/logs/turbine-api/turbine-api/ /logs/turbine-api-worker/turbine-api-worker/ |
| UI | ui |
/logs/ui/ui/ |
| Validator | validator turbine |
/logs/validator/validator/ /logs/validator/turbine/ |
| Vector | vector |
/logs/vector/vector/ |
| Version | version |
/logs/version/version/ |
| Zookeeper | zookeeper |
/logs/zookeeper/zookeeper/ |
If you deploy using Google Kubernetes Engine (GKE), you can also find these logs in the Google GKE console.