Jump to Content
Hydrolix
DocumentationAPI ReferenceReleases
ProductPricingDocsBlogHydrolix
Documentation
ProductPricingDocsBlog
DocumentationAPI ReferenceReleases

Welcome

  • Introduction
  • Activation
  • Management Console
  • Built-In Dashboards
    • Customize Grafana Dashboards
    • Use the Grafana Query Builder
    • Write Your Own Queries
    • Manage Grafana Users
    • Configure the ClickHouse Driver for Grafana

SOLUTIONS

  • Integrations List
  • Search Tools
    • Query Debugging
    • Custom Views
    • Query Troubleshooting
      • HTTP Response Headers
      • Query Performance Debugging
      • Active Queries
      • Query Metrics
    • Query Guidance
      • Query Efficiency
    • Query Options
      • Query Options Precedence
      • Query Options Reference
    • Hydrolix Spark Connector
      • Hydrolix Spark Connector: Databricks Deployment
      • Hydrolix Spark Connector: Microsoft Fabric Deployment
      • Hydrolix Spark Connector: AWS EMR Deployment
      • 22 April 2025 - v2.0.0-5.1.x
      • 4 February 2025 - v1.0.0-4.22.x
    • ClickHouse
      • ClickHouse Client
      • ClickHouse HTTP
      • ClickHouse Considerations
      • SQL Compatibility
      • SQL Statements
      • Custom Functions
      • Custom Dictionaries
    • DBeaver
    • HTTP Query API
    • JDBC Driver
    • Hydrolix UI
    • Microsoft .NET (Octonica)
    • MySQL Client
    • Python Library
  • Ingest Integrations
    • Akamai DataStream Integration
    • Amazon Data Firehose
    • Cribl Integration
    • Fluent Bit Integration
    • Journald Integration
    • Mux
    • Vector Integration
    • Zuplo
    • Cloudflare Integration
    • Tencent EdgeOne Integration
  • Visualization Tools
    • Grafana
    • Kibana Automatic Installation
    • Kibana Manual Installation
    • Redash
    • Superset
    • Hydrolix Search for Splunk
    • Splunk with DB Connect

Support

  • Success and Support
  • Availability SLA

Legal

  • Subject Access Request Form
  • Subprocessors
  • Terms of Service: SaaS
  • Terms of Service: On Premise
  • OSS Dependencies
  • Mutual Non-Disclosure

Privacy

  • Privacy FAQ
  • Privacy
  • Data Processing Addendum

---- On-Prem Only ----

  • On-Prem Deployment

Introduction

  • Welcome to Hydrolix!
  • The Hydrolix Data Platform
    • Core
    • Ingest
    • Merge
    • Query
    • Autoscaling
    • Management
    • Data Lifecycle
    • Alter Jobs

Deploy Hydrolix

  • Select Your Cloud Provider
  • Deploy on Google GKE
    • Install Tools
    • Prepare a Cluster
    • Deploy Hydrolix
    • Deploy Production PostgreSQL - GKE
  • Deploy on Amazon EKS
    • Prepare a Cluster
    • Deploy Hydrolix
    • Add Cluster Admins
    • Deploy Production PostGres - EKS
  • Deploy on Linode LKE
    • Install Tools
    • Prepare a Cluster
    • Deploy Hydrolix
    • Deploy Production Postgres - LKE
  • Deploy on Microsoft Azure AKS
    • Install Tools
    • Prepare a Cluster
    • Deploy Hydrolix
  • Customize Object Storage
    • MinIO
  • Upgrade Hydrolix
    • Upgrade to v4.10
    • Upgrade to v4.12
    • Upgrade to v4.14

Manage Cluster

  • Secure a Kubernetes Cluster
    • Configure IP Access
    • Enable TLS
      • Hydrolix ACME Client
      • Provision Certificate Manually
    • Kubernetes Cert Manager
      • HTTP Challenge
      • DNS Challenge on Route53
      • DNS Challenge on Cloudflare
      • DNS Challenge on Google CloudDNS
    • Certificate Troubleshooting
  • Add Custom Metadata to Pods
  • Rollout Strategies
  • Target Kubernetes Resources
  • Rate Limits
  • Scale your Cluster
    • Scale Profiles
    • Pod Descriptions
    • Custom Scale Profiles
  • Manual Resource Configuration
  • Resource Pools
  • Troubleshooting

Load Data

  • Load Data
  • Stream Ingest
    • HTTP Stream API
    • Pull Methods
      • Akamai SIEM
      • Kafka
      • Kinesis
    • Stream Settings
    • Stream Metrics
    • Stream Debugging
      • OOMKill Detector and Data Splitter
  • Batch Ingest
    • AWS S3 Notifications
    • GCP Storage Notifications
  • Batch Observability
    • Batch Metrics
  • Insert / Save Data Manually
  • Intake Spill

Manage Data

  • Catalog Metadata
  • System Health
  • Compact & Optimize Data (Merge)
    • Merge Metrics
  • Data Lifecycle Management
    • Age Metrics
  • Alter Data
    • Alter Metrics

Aggregate Data

  • Summary Tables
    • Kinesis
    • Summary Table Metrics
  • Summary Debugging

Observability

  • All Metrics
    • Hydrolix Custom Metrics
    • Age Metrics
    • Alter Metrics
    • Merge Metrics
    • RabbitMQ Metrics
    • Prometheus Batch Metrics
    • Prometheus DNS Metrics
    • Prometheus General Metrics
    • Prometheus Go Metrics
    • Prometheus Stream Ingest Metrics
    • Prometheus Kafka Metrics
    • Prometheus Merge Metrics
    • Prometheus PostgreSQL Metrics
    • Prometheus Query Metrics
    • Summary Table General Metrics
    • Summary Table Go Metrics
    • Summary Table Indexer Metrics
    • Summary Table Redpanda Metrics
    • Summary Table Storage Metrics
    • Summary Table Stream and Intake Head Metrics
    • Summary Table Stream Summary Metrics
    • Summary Table Traefik Metrics
  • Logging Configuration
  • Platform Observability
    • Kubernetes Cluster Logs
    • Metrics for Observability
    • Visualize Hydrolix Data in Grafana
    • Configure Alerts in Grafana
    • Prometheus Integration
      • Prometheus Remote Read and Write
      • Enable an Independent Prometheus Operator
  • Hydrologs
    • Hydrologs Query Examples
  • Dashboards

Advanced Configuration

  • Authentication and Authorization
    • User Permissions (RBAC)
    • User Authentication
    • Single Sign-On (SSO)
    • Enable Query Authentication
    • Enable Basic Authentication
    • Stream Authentication
    • Authentication Audit Logging
    • Password Complexity Policy
  • Hydrolix Tunables
    • Hydrolix Tunables List
    • Hydrolix Tunable Name Examples
  • Projects & Tables
  • Data Source Configuration
    • Transform Structure
    • Basic Data Types
    • Complex Data Types
    • Timestamp Data Types
    • Limiters
    • Auto Values
    • Scripting
    • Format Options
    • Test and Validate Transforms
    • WURFL Integration
    • Rejects
    • Publish Your Transform
    • Useful Data Tools & Techniques
  • Table Settings
  • Storage Settings
    • Performance Mode
    • Store Data Across Multiple Buckets
    • Distribute Data to Multiple Buckets
    • Vendor Storage Configuration
  • HDXCLI
    • Installation
    • Usage
    • Commands
    • FAQ
  • Vacuum
  • Data Enrichment

Troubleshooting

  • Documentation Quick Links
  • General Errors
  • System Components

Tutorials

  • Tutorials: Introduction
  • Load your first dataset
    • Create a Project and Table with API
    • Create a Transform with a Write Schema
    • Run the batch ingest job API
    • Query data
  • Get Started
    • Prerequisites
    • Step 1 - Model Storage
    • Step 2 - Ingest Data
    • Step 3 - Query Data
    • Next Steps
  • Getting Started with Dictionaries
  • Elastic Common Schema
  • GDELT Data
    • Basic Queries
    • Statistical aggregations
  • Work with Metrics
    • Timeseries functions
  • Work with Fastly CDN Logs
    • Fastly transaction logs
    • Visualize Fastly Data with Grafana
  • Migrate to External PostgreSQL
  • Data Export Guides
    • Hydrolix HTTP API to Google Pub/Sub in Go

Pull Methods

Suggest Edits

In addition to loading your data using the HTTP Stream API, you can use these three pull methods.

Akamai SIEM

Kafka

Kinesis

Updated about 5 hours ago