Semantic Caching at Scale, with Walmart's Chief Architect
The Walmart team has built one of the most impressive semantic caching stacks in the industry - and for the first time, we're bringing an exclusive peek inside how this was built, in a fireside conversation with Walmart's Chief Software Architect, Rohit Chatter.
Rohit's career spans 27 years across US & India, with stints at Oracle, Yahoo!, InMobi, and more.
The conversation will be hosted on the LLMs in Prod Discord server, and will cover:
How Walmart Labs incorporates Gen AI capabilities
Deep dive into their semantic caching architecture
What's next for LLM use cases in big tech
Questions from the audience!
Submiting questions
Please join the Discord server asap, and submit your questions to the event thread
We will pick high quality + top voted questions and invite you to ask them live in the talk