LLM Paper Club (Survey: DeepSeek Math, Hybrid Models)
Eugene Cheah will be leading us through
Most of it will be on the spot, but i have picked the following to burn through, seeing most of the slido has been covered
DeepSeek-Math: https://arxiv.org/pdf/2402.03300 The pre-req to R1
Mamba-in-the-llama:https://arxiv.org/pdf/2408.15237
Cause i will need to write a followup paper to the 2nd one, as its prior-work for our "RWKV-in-the-qwen (not the actual name)" : cries regarding upcoming abalation hell
PAPER CLUB EVERY WEDNESDAY: https://lu.ma/ls
SIGN UP FOR OUR YOUTUBE latentspacetv
---
we need YOU to volunteer to do rapid-fire recaps and explanations of our remaining papers on the board: https://app.sli.do/event/bNV6mo3BFGhe8Bqzb1tonb/live/questions
please sign up in #llm-paper-club in https://www.latent.space/p/community discord