Cover Image for AI by Hand ✍️ Seminar: Foundation (AI Eval)
Cover Image for AI by Hand ✍️ Seminar: Foundation (AI Eval)
Avatar for AI by Hand ✍️
Presented by
AI by Hand ✍️
824 Went

AI by Hand ✍️ Seminar: Foundation (AI Eval)

Zoom
Registration
Past Event
Welcome! To join the event, please register below.
About Event

​In 2026, I’ve made a personal commitment to teach one live AI seminar every week by hand ✍️.

  • ​Foundation: intuition, math, and mental models of core AI concepts, for beginners.

  • ​Frontier: research papers, algorithm, and architectures used by frontier models, for advanced AI engineers and researchers.

​Live attendance is free.

​The recordings and Excel workbooks are available for members of the AI by Hand Academy.


​This Week's Agenda:

​Guest Expert

​Ofer Mendelevitch (Vectara)

​Foundation

​AI Eval Metrics

  1. ​Perplexity

  2. ​Cross-Entropy Loss

  3. ​Negative Log-Likelihood (NLL)

  4. ​KL Divergence

  5. ​Accuracy

  6. ​Precision, Recall, F1

  7. ​BERTScore

  8. ​BLEU

  9. ​UMBRELA

  10. ​ROUGE

​

​This seminar is sponsored by Vectara.

​

​Previous Seminars:

AI by Hand ✍️ Seminar: Foundation (TPU) → Frontier (GDPO)
 
AI by Hand ✍️ Seminar: Foundation (Attention) → Frontier (SLM)
 
AI by Hand ✍️ Seminar: Foundation (Gen AI) → Frontier (mHC)
 
Avatar for AI by Hand ✍️
Presented by
AI by Hand ✍️
824 Went