Dataset Version Management refers to the process of tracking and managing changes to datasets over time. Verodat version control helps manage and track changes to the dataset. It allows multiple people to collaborate on a dataset and keeps a history of changes.
You can see version information inside the dataset "Version Info" tab:
Verodat manages versions in three different states:
Design:
As the name suggests, it is used to design datasets. Dataset will be created in design state only. You can:Setup and manage Datasets
Add, edit, or delete dataset target fields
Stage:
The staging state is a near replica of the live environment and is used for testing datasets before they are deployed live. It ensures that everything works as expected in a controlled setting. Still, you can:
Create and update Mappings
Live:
The live a final state where actual client data will reside in datasets. You cannot edit anything here inside dataset configurations. You can:
Create and update Mappings
Table of Content
Add or update a dataset and settings:
The dataset you create will only get created in the design state. You can make changes to an existing dataset, such as adding or updating target fields and rules in design state only.
For creating a new dataset, adding fields, and setting up rules, you can read more
To update a dataset settings, navigate to the dataset and settings tab:
You can edit the dataset description until your first upload to your dataset.
To make changes to Target fields, navigate to "Target fields":
Click on "Add Target Field" to add new target field
Click on field name to edit an existing target field
Promote changes:
To publish changes that you have made in design, you need to navigate to "Change Management" from left navigation:
Various types of 'change statuses' will be represented by different color codes to indicate how the changes will function or behave:
Green: Indicates everything is fine; no changes have been made to the datasets.
Yellow: Indicates that attention is required, but no critical changes have occurred, including statuses such as MINOR and CREATED. Such changes include:
Create new datasets
Description changes to existing datasets or target fields
Red: Indicates that attention is required due to a MAJOR change in the dataset, which may impact other datasets. Such changes include:
Add or update target fields
Add or update rules
Purple: Indicates that a dataset has been deleted
You can view the changes by clicking on the three dots and show changes:
It will highlight changes in the popup window:
You can view changes for Design to Staging and Staging to Live by clicking on the two tabs:
Click on Promote to move changes from Design to Staging:
Once you promote changes from design to staging, it will enable the promote button for Staging to Live.
If you are not promoting change from Staging to Live and making changes in design, it will again enable the Promote button for Design to Staging.
View change history
To view change history, navigate to "Change Management" and click on "Change History"
It will list all the version history that has been promoted:
You can click on three dots and click "Download Config" will download the configuration json file for that specific version.
On hovering over a right tick, you can see when and who has made the promotion:
Delete dataset:
If you delete a dataset from Design or Staging, it will not permanently delete a dataset; it will stay as it is in live if you are not promoting it to live.
But if you delete a dataset from Live, it will automatically get deleted from Design and Staging.
To delete a dataset, go to datasets and change to listing instead of Grid:
Click on three dots to delete a dataset:
Import Data:
If you have made changes to the dataset in Design and if you promote changes from Design to Staging, it will make an option available to "Import Data" in the Staging dataset to import data from the previous version:
Select Version to import data from and click OK.
Once you promote changes from stage to live, it will automatically create an upload to import data from a specified version in live:
