Loading Data

πŸ‘

To ingest data:

  1. Choose the destination table
  2. Define a Transform (Write Schema)
  3. Choose a method of ingest.
  4. Start Ingestion

Choose your destination Table

Choose where the data should reside. Create a Project and/or Table.

Define a Transform Schema

To load data the system needs to be told about the data type, format, and the structure of the incoming data. This is achieved through the use of a transform schema.

Choose a method of Ingest

Data can be ingested into Hydrolix using the HTTP Streaming API, Kafka or by configuring a Batch Job. You can use one or all of them to load data.

Kick off Ingestion

  • Batch Jobs are started via the UI or Batch Jobs API or start uploading files to your bucket (AWS Notify).
  • For Streaming, it is by calling the HTTP Streaming API
  • Kafka, start your Kafka brokers.

Did this page help you?