90/30 Club Reading - Kimi K3: Open Frontier Intelligence

​☕️📝 Paper Link 📝☕️

​Kimi K3: Open Frontier Intelligence

​Full paper: https://arxiv.org/pdf/2607.24653

​We will be discussing the full Kimi K3 technical report!

Kimi K3 is a 2.8T parameter Mixture-of-Experts model with 104 billion activated parameters, native vision capabilities, and a 1-million-token context window. Kimi K3 is built on Kimi Delta Attention and Attention Residuals, which improve information flow across sequence length and model depth.

​The report covers the full architecture, pre-training, post-training, and infrastructure that went into training this SOTA open-weights model.

​Event Schedule:

​7pm to 8pm --> quiet reading time, grab a snack and read! (optional)

​8pm to 9pm --> open discussion about the paper 📝

​9pm --> we have our space for a bit longer, stay to socialize or network!

​Our event is hosted within Mox SF, the gracious donors of the space we will meet.