AI Scale Talks EP.3 | Deploying an AI Platform on Infrastructure You Don’t Control

​AI Scale Talks is a four-part live webinar series from Lablup. The series theme is "From Cell to Factory": each week we scale up one level, from a single inference engine to full-scale AI infrastructure operations.

​EP.3 starts with AI platform on infrastructure. Deploying an infrastructure platform in an on-premises environment is not simply a matter of running installation scripts. Every customer brings a different network, security policy, hardware stack, and set of operational procedures and installation and upgrades have to be generalized across all of them while still delivering a consistent user experience. This talk covers the problems we've encountered, and the lessons we've drawn, from deploying and operating a platform on customer infrastructure that we don't control.

​➡️ Format

• ​40-minute session + 10-minute live Q&A

• ​Live on Zoom. The join link is shared with registered guests.

​📆 All episodes air Wednesdays at 9:00 AM PT.

• ​EP.1 | Aug 26 | High-performance LLM/VLM inference with MLxcel engine, Jeongkyu Shin

• ​EP.2 | Sep 2 | Accelerating LLM Inference: From Speculative Decoding to Diffusion LLMs, Junbum Lee

• ​EP.4 | Sep 16 | You Built the Token Factory. Who Runs It?, Jongmin Kim