Keynote Lecture: GPU by Hand ✍️ (sponsored by Together AI)

​I will teach you an advanced AI topic by hand ✍️, not taught anywhere else!

​Title:

​GPU by Hand ✍️ Together 🔵⚪️ from Hopper to Blackwell

​The leap from Hopper to Blackwell isn’t just a story of “faster GPUs” — it’s a fundamental rethinking of how every layer of the stack is organized to unlock the next frontier of AI scale. And as typical in an AI by Hand lecture, instead of focusing on benchmarks from the outside, we will dive inside the black box — unpacking the math behind these advances and making the underlying mechanisms accessible to you.

​Outline

• ​Primer: Grid -> Block -> Warp -> Thread

• ​Quantization: FP8 -> MXFP4

• ​Scaling: Layer -> Micro-Tensor

• ​Packaging: Single-Die -> Dual-Die

• ​Communication: In-GPU -> In-switch reduction

​🔥 This lecture is sponsored by Together AI and registrants will opt into their communications.