Jump to Content
Hydrolix
DocumentationAPI ReferenceReleases
ProductPricingDocsBlogHydrolix
Documentation
ProductPricingDocsBlog
DocumentationAPI ReferenceReleases

Welcome

  • Introduction
  • Activation
  • Management Console
  • Built-In Dashboards
    • Customize Grafana Dashboards
    • Use the Grafana Query Builder
    • Write Your Own Queries
    • Manage Grafana Users
    • Configure the ClickHouse Driver for Grafana

SOLUTIONS

  • Integrations List
  • Search Tools
    • Query Debugging
    • Custom Views
    • Query Troubleshooting
      • HTTP Response Headers
      • Query Performance Debugging
      • Active Queries
      • Query Metrics
    • Query Guidance
      • Query Efficiency
    • Query Options
      • Query Options Precedence
      • Query Options Reference
    • Hydrolix Spark Connector
      • Hydrolix Spark Connector: Databricks Deployment
      • Hydrolix Spark Connector: Microsoft Fabric Deployment
      • Hydrolix Spark Connector: AWS EMR Deployment
      • 22 April 2025 - v2.0.0-5.1.x
      • 4 February 2025 - v1.0.0-4.22.x
    • ClickHouse
      • ClickHouse Client
      • ClickHouse HTTP
      • ClickHouse Considerations
      • SQL Compatibility
      • SQL Statements
      • Custom Functions
      • Custom Dictionaries
    • DBeaver
    • HTTP Query API
    • JDBC Driver
    • Hydrolix UI
    • Microsoft .NET (Octonica)
    • MySQL Client
    • Python Library
  • Ingest Integrations
    • Akamai DataStream Integration
    • Amazon Data Firehose
    • Cribl Integration
    • Fluent Bit Integration
    • Journald Integration
    • Mux
    • Vector Integration
    • Zuplo
    • Cloudflare Integration
    • Tencent EdgeOne Integration
  • Visualization Tools
    • Grafana
    • Kibana Automatic Installation
    • Kibana Manual Installation
    • Redash
    • Superset
    • Hydrolix Search for Splunk
    • Splunk with DB Connect

Support

  • Success and Support
  • Availability SLA

Legal

  • Subject Access Request Form
  • Subprocessors
  • Terms of Service: SaaS
  • Terms of Service: On Premise
  • OSS Dependencies
  • Mutual Non-Disclosure

Privacy

  • Privacy FAQ
  • Privacy
  • Data Processing Addendum

---- On-Prem Only ----

  • On-Prem Deployment

Introduction

  • Welcome to Hydrolix!
  • The Hydrolix Data Platform
    • Core
    • Ingest
    • Merge
    • Query
    • Autoscaling
    • Management
    • Data Lifecycle
    • Alter Jobs

Deploy Hydrolix

  • Select Your Cloud Provider
  • Deploy on Google GKE
    • Install Tools
    • Prepare a Cluster
    • Deploy Hydrolix
    • Deploy Production PostgreSQL - GKE
  • Deploy on Amazon EKS
    • Prepare a Cluster
    • Deploy Hydrolix
    • Add Cluster Admins
    • Deploy Production PostGres - EKS
  • Deploy on Linode LKE
    • Install Tools
    • Prepare a Cluster
    • Deploy Hydrolix
    • Deploy Production Postgres - LKE
  • Deploy on Microsoft Azure AKS
    • Install Tools
    • Prepare a Cluster
    • Deploy Hydrolix
  • Customize Object Storage
    • MinIO
  • Upgrade Hydrolix
    • Upgrade to v4.10
    • Upgrade to v4.12
    • Upgrade to v4.14

Manage Cluster

  • Secure a Kubernetes Cluster
    • Configure IP Access
    • Enable TLS
      • Hydrolix ACME Client
      • Provision Certificate Manually
    • Kubernetes Cert Manager
      • HTTP Challenge
      • DNS Challenge on Route53
      • DNS Challenge on Cloudflare
      • DNS Challenge on Google CloudDNS
    • Certificate Troubleshooting
  • Add Custom Metadata to Pods
  • Rollout Strategies
  • Target Kubernetes Resources
  • Rate Limits
  • Scale your Cluster
    • Scale Profiles
    • Pod Descriptions
    • Custom Scale Profiles
  • Manual Resource Configuration
  • Resource Pools
  • Troubleshooting

Load Data

  • Load Data
  • Stream Ingest
    • HTTP Stream API
    • Pull Methods
      • Akamai SIEM
      • Kafka
      • Kinesis
    • Stream Settings
    • Stream Metrics
    • Stream Debugging
      • OOMKill Detector and Data Splitter
  • Batch Ingest
    • AWS S3 Notifications
    • GCP Storage Notifications
  • Batch Observability
    • Batch Metrics
  • Insert / Save Data Manually
  • Intake Spill

Manage Data

  • Catalog Metadata
  • System Health
  • Compact & Optimize Data (Merge)
    • Merge Metrics
  • Data Lifecycle Management
    • Age Metrics
  • Alter Data
    • Alter Metrics

Aggregate Data

  • Summary Tables
    • Kinesis
    • Summary Table Metrics
  • Summary Debugging

Observability

  • All Metrics
    • Hydrolix Custom Metrics
    • Age Metrics
    • Alter Metrics
    • Merge Metrics
    • RabbitMQ Metrics
    • Prometheus Batch Metrics
    • Prometheus DNS Metrics
    • Prometheus General Metrics
    • Prometheus Go Metrics
    • Prometheus Stream Ingest Metrics
    • Prometheus Kafka Metrics
    • Prometheus Merge Metrics
    • Prometheus PostgreSQL Metrics
    • Prometheus Query Metrics
    • Summary Table General Metrics
    • Summary Table Go Metrics
    • Summary Table Indexer Metrics
    • Summary Table Redpanda Metrics
    • Summary Table Storage Metrics
    • Summary Table Stream and Intake Head Metrics
    • Summary Table Stream Summary Metrics
    • Summary Table Traefik Metrics
  • Logging Configuration
  • Platform Observability
    • Kubernetes Cluster Logs
    • Metrics for Observability
    • Visualize Hydrolix Data in Grafana
    • Configure Alerts in Grafana
    • Prometheus Integration
      • Prometheus Remote Read and Write
      • Enable an Independent Prometheus Operator
  • Hydrologs
    • Hydrologs Query Examples
  • Dashboards

Advanced Configuration

  • Authentication and Authorization
    • User Permissions (RBAC)
    • User Authentication
    • Single Sign-On (SSO)
    • Enable Query Authentication
    • Enable Basic Authentication
    • Stream Authentication
    • Authentication Audit Logging
    • Password Complexity Policy
  • Hydrolix Tunables
    • Hydrolix Tunables List
    • Hydrolix Tunable Name Examples
  • Projects & Tables
  • Data Source Configuration
    • Transform Structure
    • Basic Data Types
    • Complex Data Types
    • Timestamp Data Types
    • Limiters
    • Auto Values
    • Scripting
    • Format Options
    • Test and Validate Transforms
    • WURFL Integration
    • Rejects
    • Publish Your Transform
    • Useful Data Tools & Techniques
  • Table Settings
  • Storage Settings
    • Performance Mode
    • Store Data Across Multiple Buckets
    • Distribute Data to Multiple Buckets
    • Vendor Storage Configuration
  • HDXCLI
    • Installation
    • Usage
    • Commands
    • FAQ
  • Vacuum
  • Data Enrichment

Troubleshooting

  • Documentation Quick Links
  • General Errors
  • System Components

Tutorials

  • Tutorials: Introduction
  • Load your first dataset
    • Create a Project and Table with API
    • Create a Transform with a Write Schema
    • Run the batch ingest job API
    • Query data
  • Get Started
    • Prerequisites
    • Step 1 - Model Storage
    • Step 2 - Ingest Data
    • Step 3 - Query Data
    • Next Steps
  • Getting Started with Dictionaries
  • Elastic Common Schema
  • GDELT Data
    • Basic Queries
    • Statistical aggregations
  • Work with Metrics
    • Timeseries functions
  • Work with Fastly CDN Logs
    • Fastly transaction logs
    • Visualize Fastly Data with Grafana
  • Migrate to External PostgreSQL
  • Data Export Guides
    • Hydrolix HTTP API to Google Pub/Sub in Go

Stream Ingest

Suggest Edits

Hydrolix has a number of methods to stream data into the Hydrolix platform.

  • HTTP Stream API
  • Kafka
  • AWS Kinesis

Updated 3 months ago