17 April 2023 - v3.36.10
over 1 year ago by Nate Contino
You can download version 3.36.10 here.
Upgrade on GKE:
kubectl apply -f "https://www.hydrolix.io/operator/v3.36.10/operator-resources?namespace=${HDX_KUBERNETES_NAMESPACE}&gcp-storage-sa=${GCP_STORAGE_SA}"
Upgrade on EKS:
kubectl apply -f "https://www.hydrolix.io/operator/v3.36.10/operator-resources?namespace=${HDX_KUBERNETES_NAMESPACE}&aws-storage-role=${AWS_STORAGE_ROLE}"
General
- Added support for ARN (Amazon Resource Name) roles for Kinesis stream ingestion.
- Introduced the ability to ingest Cloudwatch logs as individual messages (instead of batches of messages) with the Cloudwatch subtype.
- Added
datastore_project_id
configuration field to assist ingestion from Kinesis streams with a [checkpointer hosted in GCP](https://docs.hydrolix.io/docs/ingest-kinesis#specify-an-alternative-checkpoint-datastore. - Added support for summary tables for Kinesis data sources via the
settings.summary.sql
Kinesis configuration. - Renamed "credentials" configuration to "access_details".
- Added configuration options for the names of SIEM credential environment variables.
- Added configuration to limit internal event queue write size with
message_queue_max_rows
. - Added configuration for concurrency in internal queue reads; first, the
KAFKA_READ_CONCURRENCY
environment variable; second, theCONTAINER_CPU_LIMIT
environment variable; finally, the detected CPU count. - Increased timeout for Kinesis stream ingestion from 100 seconds to 200 seconds.
- Updated the layout of the System Health UI.
- Added
HYDROLIX_LICENSE
environment variable, which contains a copy of the Hydrolix license accessible from all pods of your Hydrolix cluster. - Added support for token authentication in TCP requests.
- Increased Linode load balancer throttle floor.
- Added
DISABLE_DISK_CACHE
tunable, which lets query peers immediately delete partition metadata from disk after use.
Notable Bug Fixes
- Added redirect when System Health returns a query.
- Disabled "retrieve logs" button when System Health fetches a query.
- Fixed incorrect endtime selection flow in System Health.
- Added clearing indicators to dropdowns in System Health.
- Added a tooltip when the System Health "copy SQL" button is clicked.
- Downgraded log level from "critical" to "warn" for message indicating LRU cache "redzone reached".
- Upgraded Turbine Authorizor log level from "trace" to "info".
- Fixed the operator setting the storage class to "gp3" when running in Linode but using an AWS S3 bucket.
- Fixed ingestion peer caching partition metadata to disk unnecessarily.