Storage Routes

This guide explains how to configure data ingestion routes using the supported storage methods in BettrData.io.

Creating a New Route

Navigate to Data Sources

In the left-hand menu, select Data Sources.

The Manage Data Sources screen will appear, showing 5 sections:

• Data Owners
• Storage Routes
• Integration Routes
• Integration Marketplace
• BD Select Sources

Ensure a Data Owner Exists

A route must be associated with a Data Owner.

• If the desired owner does not appear in the list:
1. Go to the Data Owners section.
2. Click NEW.
3. Enter the new Data Owner Name and Save.
4. A Client ID will be assigned and the new owner will now be available to select under Storage Routes.

Create a New Storage Route

Navigate to the Storage Routes tab and to the Manage Storage Routes section.

Select an Owner from the dropdown list.

Click the New Route button.

You’ll be presented with two options for creating a new route:

• Create Storage Route
• Create SFTP Account

Note: Selecting Create SFTP Account will automatically create both a hosted SFTP account and a corresponding route that BettrData will scan.

Create Storage Route

If you select Create Storage Route, you will see the following fields:

• Description (optional)
• Protocol (dropdown)

• Choose a protocol based on how data will be transferred:

Local Storage

• Upload Route/<Option>

Cloud Storage

• Amazon S3
• Azure Blob
• Google Cloud Storage

Server Storage

• FTP
• SFTP

Create SFTP Account

When configuring a New SFTP route, all required fields (highlighted in red) must be completed:

• Description (optional): Add a label to help identify the route.
• Host: Enter the remote server’s hostname.
• Port: Specify the port number used for the SFTP connection.
• Username: Provide the login username.
• Password: Enter the connection password.
• You can update this later by clicking Reset, entering a new password, and selecting Save.
• Directory: Specify the directory path where files are stored on the server.
• Enabled: Specify if you want files to automatically load. See more auto-load info below.

Local Storage (BD Files.com Server)

When you select Local Storage, the system will autofill the required fields. This route type connects to a local files.com SFTP server:

• The Host is bettrdata.local.
• The Local Storage option refers to BettrData's built-in, SFTP system Files.com, is auto-filled, and will use the /load/... directory structure. 
• /load/<owner_name>/<optional_brands>/<optional_title>
• The directory is created on the server once the route is saved.

Note: Using the local SFTP server is optional. If you choose this method, request credentials from your Account Manager.

☁️ Amazon S3

Required fields:

• Bucket
• Access Key ID
• Secret Access Key
• Path

Azure Blob Storage

Required fields :

• Bucket
• Secret Access Key
• Directory

Google Cloud Storage (GCS)

Required fields:

• Bucket
• Key File Contents
• Directory

Automatic Downloads

Check the Enabled checkbox to enable automatic downloading of data from the route:

⚠️ Before Enabling Automatic Downloads

If you’re unsure whether to enable automatic downloads for a source:

• Do not check the Enabled checkbox yet.
• Consult with your team or Account Manager to confirm before enabling automatic downloads.
• Ensure the following fields are completed:
• Protocol
• Host
• Port
• Username
• Password
• Directory
• Save the route
• Consult with your team or Account Manager to confirm before enabling automatic downloads

No Delete Option

By default, files are deleted after transmission to reduce the risk of duplication.

• To retain files after transmission, check the No Delete checkbox.

The List Files page will display. Click the List Files on Route button. All files included in the route will display.

From here you can review each file and confirm whether you’d like all files in the route to be Enabled for automatic transmission. If you determine that all files on the route should be enabled, simply return to the Edit Routes page and check the Enabled checkbox. Files that are enabled for automatic conversion will display on the Manage Files page located on the Home page Files tab to begin processing.

Notice that when the Enabled checkbox is checked, the No Fail checkbox will default to checked which prompts the system to continue to try to pull in data if initially unsuccessful.  Uncheck the No Fail checkbox to turn off this feature. Also, checking the Enabled checkbox will disable the No Delete checkbox to avoid downloading the same file multiple times

Checking the No Delete checkbox will prevent downloaded data from being deleted. For example, you may not have access rights to delete the data or the site owner may not want the data removed. To enable the No Delete feature, the Enabled checkbox must be unchecked.

Click Save when all the routing information has been completed. Notice that all required fields highlighted in red must be completed before the Save button will become enabled.

To create additional routes for the owner, click the New button on the Manage Routes page again and repeat the process. A single owner can include one or more routes

Note that the system maintains Edit Route versioning so if there is more than one user making changes at the same time, or you have multiple windows open working on the same routing information, the system will alert you on Save.  A message will display letting you know that Save has failed due to a version conflict and that the page has been refreshed with the newest changes. Make your changes again and select Save.