Auto Values

Hydrolix has automatic values that can be included within a transform, listed below.

Additionally, there are WURFL-related auto values available for device identification when WURFL is enabled.

Auto Value NameDescriptionStreamKafkaBatch
current_timeCurrent timeYesYesYes
index_poolPool name used by the indexer (stream peer, kafka peer, batch peer)YesYesYes
input_filenameFor batch only, specify the filename indexed. The filename is the full s3 path:
s3://bucket/folder/subfolder/filename.csv
NoNoYes
intake_methodSpecify the intake method (Batch, Stream / Kafka)YesYesYes
intake_poolPool name used by the intake service (stream head, batch head)YesYesYes
kafka_topicSpecify the Kafka topic used to index the dataYesNoNo
project_nameName of the project where the data will be indexedYesYesYes
project_revisionRevision number of the project where the data will be indexedYesYesYes
project_uuidUUID of the project where the data will be indexedYesYesYes
receive_timeTime when the data is receivedYesYesYes
table_nameName of the table where the data will be indexedYesYesYes
table_revisionRevision number of the table where the data will be indexed.YesYesYes
table_uuidUUID of the table where the data will be indexedYesYesYes
transform_nameName of the transform used to index the dataYesYesYes
transform_revisionRevision number of the transform used to index the dataYesYesYes
transform_typeTransform type (csv or json).YesYesYes
transform_uuidUUID of the transform used to index the data.YesYesYes
input_filename_segment_[0-12]Extract part of the filename with batch/autoingest where the separator is /
Example:
s3://bucket/folder/subfolder/filename.csv
s3 = input_filename_segment_0
bucket = input_filename_segment_2
folder = input_filename_segment_3
subfolder = input_filename_segment_4
filename.csv = input_filename_segment_5
NoNoYes

To use those automatic value you can add the following in your transform:

{
    "name": "filename",
    "datatype": {
        "type": "string",
        "index": true,
        "source": {
            "from_automatic_value": "input_filename"
        }
    },
},

The source should be from_automatic_value and then the value name that you can find in the table above.