Cover Image for πŸ¦„ ai that works: Evaling Multimodal Pipelines
Cover Image for πŸ¦„ ai that works: Evaling Multimodal Pipelines
Avatar for Boundary
Presented by
Boundary
We make BAML, a programming language for agents.
Some event recordings are available here: https://github.com/hellovai/ai-that-works
Hosted By
138 Went

πŸ¦„ ai that works: Evaling Multimodal Pipelines

Virtual
Registration
Past Event
Welcome! To join the event, please register below.
About Event

β€‹πŸ¦„ ai that works

​A weekly conversation about how we can all get the most juice out of todays models with @vaibcode & @dexhorthy

​https://github.com/ai-that-works/ai-that-works

​

​Evals for Text Pipeline are one dimension, but multi-modal is a whole different ball game. This week we'll dive into how we built an eval system around a receipt data base (handwritten ones, edited, photos, pdfs, all of them).

​Pre-reading

​To prevent repeating the basics, we recommend you come in having already understanding some of the tooling we will be using:

  • ​Discord

  • ​Cursor or VS Code

  • ​Programming languages

    • ​Application Logic: Python or Typescript or Go

    • ​Prompting: BAML (recommend video)

​Meet the Speaker πŸ§‘β€πŸ’»

​​​Meet Vaibhav Gupta, one of the creators of BAML and YC alum. He spent 10 years in AI performance optimization at places like Google, Microsoft, and D. E. Shaw. He loves diving deep and chatting about anything related to Gen AI and Computer Vision!Β 

​Meet Dex Horthy, founder at HumanLayer and coiner of the term Context Engineering. He spent 10+ years building devops tools at Replicated, Sprout Social and JPL. DevOps junkie turned AI Engineer.

Avatar for Boundary
Presented by
Boundary
We make BAML, a programming language for agents.
Some event recordings are available here: https://github.com/hellovai/ai-that-works
Hosted By
138 Went