1.3.9

• System: Rework Route UI
• Feature: Add link in top nav bar to easily file support ticket
• * Feature: Create a support ticket if a BettrData platform instance is not in a good state

Requires SYSTEM_MONITOR_TOKEN in ~/.bettrdata/.config

• System: Update to cooker:2.6.3

Bug: Quote field when it contains delimiter when writing delimited output

• Feature: Ability to set Convert header.count to a (positive) number other than 0 or 1 providing the ability to drop multiple header lines

1.3.8

• Feature: Admin: Remove fields from types when removed
• Feature: Admin: Add ability to add web links
• * Feature: Pre-processing hook w/ configuration in admin

Requires configuration → gatherer →attributes

Copy

"preprocessingHook": {
    enabled:false,
    script:null
}

• Feature: Bulk "Mark as Done"
• Feature: Always confirm when deleting entities that do not require a save
• Bug: Filters when searching under the Unidentified state is inconsistent
• * Hotfix: Forgive a non-zero exit when processing a pgp file if it produced an output and the following configuration is set to true

Requires configuration → gatherer →attributes

forgivePgpNonZeroExit:true|false

1.3.7

• Feature: Expose service settings in Administration panel
• * Feature: Webhooks for file created, converted, reviewed & deleted

Requires configuration → back → attributes

Copy

 "webhooks" : {
    "file" : {
        "created" : null,
        "converted" : null,
        "reviewed" : null,
        "deleted" : null
    }
}

• Feature: Pessimistic locking, lock files so that other users cannot edit them6797e97382665900161b52e0
• Feature: File history (show previous record count comparisons as graph)
• System: UI consistency updates (buttons, save notifications, etc.)
• System: Encrypt profile data

1.3.6

• Feature: Convert Summary View: Move density count to table
• Feature: Client details improvements
• * Feature: Add feature flag to convert type prediction

Requires configuration → gatherer → "attributes.enableSmartTypes" : true

• * Feature: Support local file system ingestion

Requires export FS_ROUTE_ROOT=<directory to mount> in ~/.bettrdata/.config

Note: must use sub-directories (for write) under the mounted root for chroot permission standards

• System: Sync Default Configs
• System: Update to cooker:2.6.2
• System: Refactor S3 property in transform.io configuration
• Feature: Name parsing updates: single token name fix
• Bug: Delete convert does not work with convert type
• Bug: Copy convert functionality does not work with fixed length

1.3.5

• Feature: Include Jupyter Lab / Notebooks as an optional service (requires stand-alone token)
• Feature: Add profiles to printable layout overview
• System: Update to cooker:2.6.1

1.3.4

• Feature: Builder, copy from existing convert at creation
• Feature: External link improvements
• System: Restart Policy on all Containers
• Bug: Files tab, File/Run must be clicked twice to open modal
• Bug: Unable to delete a failed production convert run

1.3.3

• System: Database maintenance
• Feature: Address Standardization Integration
• Includes: matchcode, and name soudEx
• System: Update to cooker:2.6.0

1.3.1

• System: Update to cooker:2.5.8
• Bug: Auto Convert: Always default to first convert
• Bug: Don't allow duplicate converts
• Bug: File Attributes display issue (for missing attributes)
• Bug: Safeguard missing fields in auto validate
• Feature: Health checks
• Feature: Route Descriptions
• Feature: Client: Duplicate including routes and converts

1.3.0

• Feature: Add text/fortran mime type as text
• System: Update to cooker:2.5.7
• Feature: Convert duplicate: disable by default
• * Feature: AutoConvert: Custom Convert Ready Trigger

1.2.8

• Bug: Filenames with spaces causing invalid filename
• Feature: Force save upon Run in convert builder

1.2.7

• Bug: Correct list routes with spaces and directories
• Bug: Fix for review dates not being set correctly
• Bug: Specific report will not display correctly

1.2.6

• Feature: REST endpoint (/:collection/:id/set) to update only specific object properties

1.2.5

• Feature: Ability to search files using custom file attributes

1.2.4

• Feature: Routes: Refactor to allow search across owners

1.2.3

• Bug fix: Duplicating route twice with same client selected does not duplicate
• Save button consistency
• Notifications as toasts (rather than alerts)

1.2.2

• Custom Links: Add the following property to configuration → global→ attributes document

"externalLinks" : [ 
    {
        "type": "window"
        "display" : "BettrData"
        "url" : "https://bettrdata.io"
    }
]

• System changes to support transform.io 2.5.3

1.2.1

• * Email 1x per day for failed routes that are enabled
• Route Duplication
• File Search on MD5
• Duplicates: Allow Override on Re-Process to force through
• File Reprocess Parent: Alert that you are about to reprocess a parent which may produce duplicate children
• * Pgp Support
• Requires: PGP_KEY=<PRIVATE_PGP.asc> in ~/.bettrdata/.config

1.2.0

• Convert error log in modal
• Route: No Fail is default
• Count route failures even if No Fail is set
• Copy Output: If single file output , add filename to path
• Bug: Validate required field more accurately
• Convert: Show filename in tab bar & info modal
• File Manage: show MD5

1.1.9

• Disable SmartTypes

1.1.8

• Attributes Text Type

1.1.7

• Bug: Do not consider byte count when checking for existence of files on remote server
• Bug: Reset route failure counter on success

1.1.6

• Bug: FileTransferService does not have reference to configuration, causes route failures after long runs

1.1.5

• Ability to set an alias for a file giving user the appearance of a filename rename

1.1.4

• Manage Converts tab
• Home tab status counts

1.1.2

• Sort data profiles in builder and report pages
• Bulk actions for: delete, replace, reprocess
• Update active row color to #ECC478

1.1.1

• Add forgot password link to login screen
• Files Tab View: Allow display of custom columns
• * Client Attributes: Change to Attributes, update File Manage --> Attributes
• Auto insert attributes marked for Client or File respectively
• Do not need to explicitly add any more
• Cannot remove
• Link to Release Notes in Admin:Status Screen

1.1.0

• * Configurable user/identity pools
• Requires COGNITO properties in ~/.bettrdata/.config
• Ability to register and change password after added by admin
• Ability to change password at <host>/forgot
• Convert Report: Fix Auto Validate spelling
• Builder: If the format is fixed length, don't show Build New Convert button if the user has not entered fixed length options
• Route/List: Return error to user on route-edit list files
• MongoDb 4.0.9 → 4.2.3

1.0.37

• File List Paging

1.0.36

• Fix Bug - File : Attributes Tab Active
• Virtual File Support - Ability to create a new file from 1:N similar files
• Files - Bulk :: Hold

1.0.34

• Zip passwords in UI
• Zip password support
• Clipboard input/output paths
• Bug fix: Files refresh cleaner/more performance, menu stays

Cooker/Transform.io

2.6.5

• Bug: Check for alias empty string when writing a renamed single output file

2.6.4

• Feature: Email data type
• Feature: Field Hashing

2.6.3

• Bug: Quote field when it contains delimiter when writing delimited output

2.6.2

• System: Refactor S3 configuration property
• Name parser updates: single token name fix

2.6.1

• Bug: Field value to None messes up the "Missing" counts

2.6.0

• Feature: Address standardization Integration
• Bug: Setting ParsedName to None causing a reporting error

2.5.9

• Feature: Ensure all name parsing is done before code override

2.5.8

• Bug: Add leading letter in front of name & full name for fixed output
• Bug: Do not blank fields starting with # , second location

2.5.6

• System: Increase parallelization when writing to a single output file

2.5.5

• Bug: Do not blank fields starting with #

2.5.4

• Bug: JSON property for Client id was not deserializing from _id

2.5.3

• * Ability to run a pre-apply setup function, allows 1x setup reusable artifacts in code overrides
• codeOverride signatures must match:

  override def setup(client: Option[Client],file: Option[File]): Option[Any] = {
    None
  }

  override def overrideCode(holder: Holder, setup:Option[Any]): Holder = {
    holder
  }

2.5.1

• Option for CR/LF (only works with fixed length outputs)

2.5.0

• Support for renaming output (allowed only when single file output option is used on local disk)
• If there is an file alias set, the alias is used. Otherwise, the output is renamed to the original filename
• Set the following in configuration for transform.io
• singleFileOutputRename: true
• singleFileOutput: true

2.4.0

• Nth (configurable) for test input quantity

2.3.0

• Virtual file support

2.2.4

• Full name update for fixed length support

2.2.1

• Ability to configure single file output

2.0.0

• * Spark 2.x

Cron

1.0.3

• MongoDb binary updates

1.0.2

• Initial release w/ maintenance corrections

Proxy

1.0.3

• Initial release w/ maintenance corrections