Verodat stores your data in a blob storage "stage" when files are committed.
With Standard or Enterprise license, you have the option to use your own AWS or Azure blob storage. With the Basic license, Verodat uses its own blob storage for data storage.
Table of content:
What is Blob Storage?
Blob storage (Binary Large Object storage) is a service provided by cloud platforms, like Microsoft Azure, Amazon S3, and Google Cloud, to store large amounts of unstructured data. This data can include images, videos, documents, backups, and any other binary or text-based files. Blob storage is optimized for storing massive amounts of data in a cost-effective and accessible way.
Set up Amazon S3 as Verodat Blob storage:
Step 1: Enter account details in Verodat
⚠️ You can only set up these steps when you are first creating your account on Verodat.
We will need the below details from your Amazon account to connect to Verodat:
Region: This refers to the geographical area where your Amazon S3 data is stored.
Access Key: The Access Key is part of your AWS credentials, acting as an identifier for programmatic access to Amazon S3.
Secret Key: The Secret Key is the other part of your AWS credentials, acting as the password paired with the Access Key.
Bucket Name: A bucket is a container in Amazon S3 where data is stored. Each bucket must have a unique name across the AWS system.
When setting up your account, you will be navigated to a screen to enter these details.
Step 2: Configure your AWS Console
Login to your AWS console: https://aws.amazon.com/console/
Choose the region from top navigation panel where your data will be stored.
Navigate to Amazon S3 Services from search or from all services.
Click on "Buckets" to list all buckets, you have to create one by click on "Create bucket'
Give a Unique Name to bucket and click "Create bucket":
In the Search bar type "IAM" and navigate to Identity and Access Management:
Navigate to the 'Users' section in the Access Management menu on the left to create a new user and generate the access key and secret key.:
Click on "Create user":
Give a unique User name and click "Next":
Choose Permission as "Add user to group" and click "Next":
Finally click on "Create user":
Click on the user created to create access key:
Click on "Create access key":
Select Use case as "Other" and Click "Next":
Add small description tag to describe the use of credentials and Click "Create access key":
Save the Access Key and Secret Key, as you won’t be able to view the Secret Key again. If lost, you will need to generate a new key
Next we need to create permissions and policies, which help you maintain security, control, and compliance when Verodat interacts with Amazon S3.
Navigate to "Permissions" and "Add Permissions" to "Create inline policy":
Select "JSON" and click "Next":
Select below actions and all resources:
- "iam:GetRole"
- "iam:CreateRole"
- "iam:GetRolePolicy"- "iam:PutRolePolicy"
- "iam:AttachRolePolicy"
- "iam:GetPolicy"
- "iam:CreatePolicy"
- "iam:AttachUserPolicy"
- "iam:GetUser"
- "sts:AssumeRole"
Provide the Policy name and click "Create policy":
Once the policy is created it will get listed inside permissions, click Add Permission from the Add Permission dropdown:
Select permission option as "Attach a policy directly" and search "AmazonS3" in Permission policies and select "AmazonS3FullAccess":
Review the permission and click "Add Permissions"
Permission added will get listed into the "Permissions Policies"
Step 3: Connect Verodat with your AWS
While setting up an account it will ask you to "Connect Blob Storage"
Select AWS as a Storage account:
Add the Region, Accesss Key, Secret Key and Bucket Name that you have generated earlier in this article:
