Verodat automates tasks like uploading and processing data to streamline workflows, and eliminate the need for manual intervention. One method to do this is to 'Automate' data submissions for your recurring data requests.
Setting up request automation removes the need to log in to Verodat daily and manually load files. Once configured, the system will automatically accept and upload files sent via a method you choose—whether via email, script, or direct connection. This ensures a seamless and efficient data processing workflow, saving time and reducing manual effort.
Table of Contents
Automate Requests
To automate requests, click on the "Requests" tab on the left-hand panel. Then click on the three ellipses in the data request section.
Click the three dots (ellipsis) and select "Manage Automation".
This opens up a new modal. "Automated Request Settings". Here you will select the settings for your automated request.
Within the setting section, there are three separate options for automation:
Upload Method (mail, script or connection)
Mail: Will accept files sent by attachment to an email address generated by Verodat.
Script: Will accept files pushed in by Curl or other scripting methods.
Connection: Enables you to connect directly to popular softwares or databases and extract data on a regular basis
Mail:
When you select the upload method "mail", you will then be asked to specify the type of file you would like to send via email attachment. Any other file types would be rejected by Verodat.
.xslx This is the default file type saved from Microsoft Excel.
.csv: A CSV (comma-separated values) file is a text file that has a specific format that allows data to be saved in a table-structured format.
.json: JavaScript Object Notation (JSON) is a standard text-based format for representing structured data based on JavaScript object syntax.
When you select ".json" or ".csv" you will be asked to "select a mapping". You should select the mapping that has been customised to the source of data that you are uploading.
Mapping: refers to the process of aligning or associating the fields in your source data with the corresponding fields in the Verodat dataset. Mapping ensures that data uploaded into Verodat is correctly structured and matches the format expected by the system.
When this step is complete, instructions on how to send your files will appear.
When you select "Excel" you will be asked to "Select Mapping", "Input data sheet name" and "Input sheet header row". Instructions for submitting your data will appear.
Input data sheet name: The input data sheet name refers to the name of the specific worksheet or tab within a spreadsheet file (such as an Excel file) that contains the data to be uploaded. Many spreadsheets have multiple sheets, and specifying the correct sheet name ensures the system or user retrieves data from the intended sheet.
Input sheet header row: A header row is the row that contains descriptive labels or names for each column, representing the type of data in that column (e.g., "Name," "Email," "Product ID," "Order Date"). Verodat uses these headers as identifiers to understand the structure and meaning of the data.
Advanced Settings:
Advanced settings allow you to make decisions about how Verodat handles exceptions and errors in your data.
If you wish, you can "Show Advanced Settings" and
Define the final processing state (Review/Approved)
Review: data will automatically get uploaded and processed, but it will not be committed to the dataset. You need to login to Verodat and manually perform the "Commit to Dataset" step:
Approved: data will automatically get uploaded, processed, and committed to the dataset.
Ignore Warning errors (Yes/No)
Yes: it will ignore all the warning errors for the validation rules and will commit data to the dataset.
No: it will not commit data to a dataset if it has validation rule warning errors.
Script:
When you select the "Script" option in the section "Upload Method" you will be asked for the "Upload Details"
.json, or
.csv
Both options ".json" or ".csv" will require you to "Select Mapping"
The "Submit your data" section will also become available and within this section, you can enter code in the section provided.
Connection:
Connectors allow you to connect and access real-time data from enterprise applications and hybrid infrastructures effortlessly with NoCode Connectivity solutions.
Connection makes it easy to connect, upload data, and automate data upload from your enterprise data source.
Connectors allow you to connect:
SaaS Platforms: Xero, Salesforce and Netsuite
Databases: MySQL, SQL Server, and Oracle
Online tools: Google sheets and Excel Online
When you select the "Connection" option in the section "Upload Method" you will be asked for the "Upload Details":
Select connection to upload data from connectors and select mapping:
Last click on "Save and Enable Connection":
Connectors articles: