Create a New Convert from Scratch
As a file begins to process it is first placed in the status of Unidentified, requiring an Output Schema Type selected on the Manage Files page to move the file onto the Status of Waiting to Convert.
You can now click on the Waiting to Convert link or select Open in Builder in the file menu to create a new convert.
File Menu Options
Fixed Width Files
While the system recognizes line length for fixed format files that are being converted, headers and their width counts must be identified and correctly matched for first-time converts. The objective for the Fixed Length Options is to:
- Create Headers and have the sum of the Width counts equal line length, and
- Have Header and Width counts equal one another.
Note that matching all criteria is crucial for accuracy and not having fields correctly matched can result in unintended results.
When Open in Builder is selected for a fixed format file, the Fixed Length Options will display.
Begin by entering the file’s headers in the Comma Separated: Field Headers field, using a comma to separate each header.
Next, enter the width for each header field in the Comma Separated: Field Widths field, using a comma to separate each value.
Note that instead of using commas, you can copy and paste the list of headers and width numbers in each field as long as there is only one header or number per row.
- The Line Length displays the total count of the line length.
- Once field Headers and header Widths have been entered, the Sum of Widths column will display the total of all the header widths.
- If the Sum of Width = Line Length a green checkmark will display in this column; otherwise a red X will display.
- Header Count displays the total number of Headers (columns).
- Width Count displays the total number of width counts (column widths) entered.
- If the Header Count Equals Width Count a green checkmark will display in this column; otherwise a red X will display.
If the Sum of Widths = Line Length column and the Header Count Equals Width Count column both display a green checkmark, no further action is needed and you can now click the Build New Convert button that appears at the bottom of the screen.
If a red X displays in either column, it will be necessary to correct the discrepancies.
Click the Build link or select the Build option from the Parse menu. The file Headers, field Widths and data will display in the BettrData.io Builder along with the Fixed Length Options enabling you to check each header and column against the Fixed Length Options for accuracy. Make corrections to the Fixed Length Option fields. Be sure to select Build each time you make changes to any of the Fixed Length Options.
If discrepancies remain, a message will display letting you know that the Fixed Length Options still contain errors, correct and build again.
Once the Sum of Widths = Line Length and the Header Count Equals Width Count both display the green checkmark you can proceed with building the new convert in the BettrData.io Builder. Select the Build New Convert button. You can now click on the Fixed Length Options text to close the option fields.
Non-Fixed Format Files
When Open in Builder is selected for a file other than a fixed format file, the Build New Convert screen will display.
Owned By, Format, Length, Type, Qualifier and Profile state is visible on the screen confirming file selection. Click on the purple Click here to Build New Convert button.
The BettrData.io Builder will display.
Columns for the input file’s field headers and the file’s output schema fields display across the screen along with different action buttons and features that can help you complete an accurate build.
Label Line
The Label Line consists of the header of the first incoming CSV file or the provided headers in the case of fixed length data. If needed, labels can be changed in the Builder for greater clarity. Label changes will not affect the data.
Field Select Line
Click on the Select Mapping field to choose a standardized field name. By not selecting a field to map to, the incoming column will not be written to the output. To identify and confirm each output field, make a Mapping selection for each column from the dropdown.
Or begin to type a selection in the Select Mapping field and the system will search and display like output fields for your choosing.
Notice also that the columns will turn purple as selections are made.
Date Format
The Date Format icon will display for field selection of Date. Click the icon to define the format for date. See the included date format options and link for additional or advanced information.
TIP: If the date in the input file is missing the day then in builder use the date format of yyyyMM and then convert will plug the day as 01.
Field, Column and Row Icons
Each column also includes icons for actions such as toggling the profile field, showing field comments, hiding the column, filtering rows and Map incoming values.
Go to Profile for more information on using the Field Toggle and profiling data.
Click on the Show Field Comments icon to display a Comment field that displays at the top of the column. Click the icon again to close the field. The icon will remain highlighted where comments are present.
Go to View in the Menu Bar Options for more information on the Hide Column and Filter Rows icons.
The Mapping icon may display in a column once a field selection is made. Click on the icon to Map Incoming Values to the output field. For example, gender can be transformed from the value of Female on the input file to the character F in the gender column.
Pay attention to any red icons that may appear in a column after making a selection—such as Set Date Format or Map Values. Click the icon to configure the date format or map incoming values to the corresponding output field.
Once formatting and/or mappings have been completed, the associated icon will turn from red to white.
After making a selection for each column and addressing any red icons, check the gray bar for any convert issues that may have occurred during the build. Convert issue counts will display in red and yellow icons. Click on the icons.
The Convert Issues screen will display. Red corresponds to Errors and yellow equals Warnings.
When you believe the build is complete and accurate, click Save in the gray bar. Always click Save after making any changes to ensure your updates are preserved.
The Save and Undo buttons become active when changes are made. If no changes are detected, these buttons will remain grayed out.
When you're ready, you can run the conversion directly from the build screen. This will transform the data from its original format into the standardized output.
Click >>Run in the gray bar to start the file conversion process.
Go to Run for further information on Run Convert.
Handling a File with Only an Email Column Loaded as Fixed-Length
This scenario can be a bit tricky, but the solution is straightforward.
Since the file contains only one column (email), and BD initially loads it as fixed-length, we can work around this by leveraging the system's ability to read the file line by line.
To resolve the issue, we configured the file as a delimited file using the pipe (|) character and set it to 1 column. This approach ensures consistency and allows the system to interpret the file correctly.
With this setup, the file should now function as expected.
Screenshot from the files Manage Data screen in the Edit File tab: