A Verodat dataset is a core entity that users can customise within the platform. It contains detailed settings and requirements for your specific data needs. Datasets help organise and structure the information, making it easier for users to manage and analyse the pertinent data.
Table of Contents
Dataset Components
A Dataset requires certain components to organise and structure the data you are uploading. Dataset components include;
the target fields required,
the structure of the data table (mappings, validations and filters)
transformation and enrichment rules
Target Fields
A target field is a column within a dataset. Target fields have four possible formats:
Integer
A whole number without any decimal part (e.g., -1, 0, 15).
String
A sequence of characters, words, or other text (e.g., "Hello, world!").
Date
Represents a specific day, month, and year (e.g., 01-01-2024).
Number
A numeric value that can be an integer or a decimal (e.g., -3, 0.75, 42).
Verodat automatically verifies that fields in data uploads are in the same format as the target field.
Mapping, Validation and Filter Rules
These rules govern the quality and scope of your data. The user configures these rules to ensure data meets the desired target state.
Mapping Rule
A mapping rule defines how source fields relate to target fields.
Validation Rule
A validation rule specifies logical conditions that data must meet to enter the data store.
Filter Rule
A filter rule enables the user to define which rows of data should enter the data store.
Transformation & Enrichment Rules
Transformation Rule
Transformation rules change data fields to ensure data is in the correct format. These rules can split or concatenate values and change field formats.
Enrichment Rule
Enrichment rules can pull fields from other datasets to enrich your data output. These can replace a field or be created as an additional field.