LLM Paper Club (NVIDIA Megatron-LM MoE Upcycling)
Registration
Past Event
About Event
this week Ethan He from NVIDIA will present his recent paper on MoE upcycling and Megatron-Core MoE!
https://arxiv.org/abs/2410.07524
https://github.com/NVIDIA/Megatron-LM/tree/main/megatron/core/transformer/moe
---
we need YOU to volunteer to do rapid-fire recaps and explanations of our remaining papers on the board: https://app.sli.do/event/bNV6mo3BFGhe8Bqzb1tonb/live/questions
please sign up in #llm-paper-club!