Skip to content

v2.23.12

Download: hdxctl-v2.23.12

Release Location⚓︎

1
wget -O hdxctl https://hdx-infrastructure.s3.amazonaws.com/hdxctl-v2.23.12 && chmod +x hdxctl

Features⚓︎

Deployment⚓︎

  • HDXCTL: Upgrade boto3 to 1.20.6
  • HDXCTL: Added support for setting a boundary policies and ARN for roles used in deployment process.

Configuration and Control⚓︎

  • Scaling: Spot Instance percentages now based on the default pool settings.
  • Security: Security Update to RDS applied with newest patches and version updated to 11.13.

Security⚓︎

  • AWS - Enable Customer-owned KMS Key support - hdxctl update --use-s3-kms-key true client_id clusterid. Note requires TLS support (below) turned on as well.
  • AWS - Enable TLS Endpoint Support - hdxctl update --use-https-with-s3 true client_id clusterid

Alter⚓︎

  • Alter-Peer: Placeholders enabled to allow for row deletion and other database/table mechanics to change data once encode.
  • Alter-Peer: Scaling and Control integration.

Ingest⚓︎

  • Transform: Allow nulls in csv quote field
  • Batch: Change batch max_minutes_per_partition setting default to 360

Observability⚓︎

  • Superset: Increase default max header size for Superset proxy

Query⚓︎

  • Query: Improved I/O scheduling for faster, more reliable performance between compute and cloud storage.
  • Query: Resiliency enhancements added to Peer restarts.
  • Query: Added missing timerange_sec, max_partitions and new admin_comment settings/circuit breakers
  • Query: Added support for custom sql settings via SETTINGS hdx_ within SQL
  • Query: Be able to use a special header X-HDX-query-settings as query settings for a query

Bug Fixes⚓︎

Configuration and Control fixes⚓︎

HDXCTL: Fix incompatibility issue with ubuntu 18.04 vs botocore

Ingest fixes⚓︎

Ingest: Improve automatic datetime value handling Ingest: Reduce log noise for greater clarity. Reduce log rejection noise.

Query fixes⚓︎

Write to S3: Fix for output results to S3 file Pools: Pool_name Bugfix for quoted strings.