SGLang Developer Meeting: Ring Buffers for Disaggregated Serving over Host Memory RDMA/EFA
Registration
Past Event
About Event
SGLang Dev Meeting: Ring Buffers for Disaggregated Serving over Host Memory RDMA/EFA
Join Alex Korte, Model Performance Engineer at Baseten, for a walkthrough of ring buffers for disaggregated serving over host memory using RDMA/EFA. Alex will explain the changes to the host-memory transfer architecture, the reasoning behind them, and the benefits they bring.
After the walkthrough, we’ll open the floor for discussion. Whether you’re building disaggregated serving systems or exploring how these transfers work, bring your questions, ideas, and pushback.
Join SGLang Slack 👉 https://slack.sglang.io/
Follow us on X 👉 /sgl_project
If SGLang helps you, consider giving us a star on GitHub. It really motivates the team. ⭐ sgl-projectsglang