Discuss Onboarding

Split Bettrdata pipeline into child pages

Action Items

• Split data pipeline so it is a child page under overviews
• Overview and child
• checkbox to fill out client database
• Checklist manifesto
• How to make documents into template
• Run for Client!

Bi-Weekly Update

• From Hugh, create a data set of auto-created case classes
• Could not get it to work
• Looks through a bunch of AI chats to see if there was any way, but could not find a way
• Recommendation
• Need to have a hardened schema?
• From Karim
• Could you
• Use of auto-boxing in java was a possibility
• From Aaron
• It sounds like we are at a dead-end?
• Hugh will check with one other person
• He will put his code
• Post Meeting
• Have to fix this somehow to make the join faster
• Replace that step in another language
• From Kadim
• Are you set on have fields?
• Married to support any fields not in convert configuration
• From Aaron
• No, they need to define it
• Pre-defining is fine
• use regex to use a shuffle and a join
• Could we try another tech/language?
• The deserialization of
• From Lukasz
• Could use parquet
• Could we set the field schema in mongo?