LLM Paper Club (ModernBERT)

​come having read: https://arxiv.org/pdf/2412.13663

​https://huggingface.co/blog/modernbert

​https://buttondown.com/ainews/archive/ainews-modernbert-small-new-retrieverclassifier/

​we dont have a leader for this yet but a lot of people want to do modernbert stuff so i hope it will just be an organic easygoing discussion haha

​---

​ Ramon might continue with a longer exploration of model merging!

​https://sakana.ai/evolutionary-model-merge/

​​https://arxiv.org/abs/2403.13187

​​https://github.com/SakanaAI/evolutionary-model-merge

​---

​we need YOU to volunteer to do rapid-fire recaps and explanations of our remaining papers on the board: https://app.sli.do/event/bNV6mo3BFGhe8Bqzb1tonb/live/questions

​please sign up in #llm-paper-club!