AI in Production by GetYourGuide
💡 Before registering for this event, please read the note about event recording and photography at the end of the event details.
👉 Want to stay connected with us and get more insights about GetYourGuide? Check out our Linktree for all the essentials: join our Slack community, dive into our tech blog, explore career opportunities, and respond to our speaker call for future events.
Welcome to the AI in Production Meetup 🚀
Curious about the practical implications of AI in the tech industry? Join us to learn how companies across the globe—and we at GetYourGuide—use AI in Production.
In our seventh meetup, we’ll dive into practical strategies for running AI systems reliably in production. Learn key patterns for designing infrastructure that can handle real-world workloads, and gain insights from experts working at the forefront of AI in production.
This meetup is geared toward ML and AI practitioners, but anyone passionate about AI and its applications is welcome. Come network with like-minded professionals, enjoy pizza and drinks, and hear from experts building AI-powered systems in Berlin.
Talk #1: Fast & Asynchronous: Drift Your AI, Not Your GPU Bill
Artem Yushkovskiy, Senior ML Engineer @ Delivery Hero
AI doesn't wait — so why do our GPUs spend half their lives idle behind REST endpoints and synchronous pipelines?
This talk is a love letter to asynchronous design for AI. We'll dive into Asya, our open-source framework that reimagines "AI serving" as a set of independent async micro-actors that communicate via message queues. Each actor runs independently and scales from zero to infinity on Kubernetes — no complex orchestration, no wasted resources. You'll see how this architecture creates a distributed system where workloads are self-balanced, multiple AI use-cases coexist in one cluster (image generation, enhancement, you name it), and your infrastructure automatically scales with demand — not against it.
If you think serving AI means POST /predict, this talk will change your mind — and maybe your GPU bill.
Talk #2: From Manual to LLMs: Scaling Product Categorization
Giampaolo Casolla, Senior Data Scientist @ GetYourGuide
How can LLMs be used to categorize hundreds of thousands of products into 1,000 categories at scale? Learn about our journey from manual/rule-based methods, via fine-tuned semantic models, to a robust multi-step process that uses embeddings and LLMs via the OpenAI APIs. This talk provides data scientists and AI practitioners with insights and best practices for deploying complex LLM-based systems into production. This includes prompt development, balancing cost vs. accuracy via model selection, testing mult-case vs. single-case prompts, and saving costs by using the OpenAI Batch API and a smart early-stopping approach. We also describe our automation and monitoring in a PySpark environment.
Schedule of the Meetup:
18:00 Doors open + Open Networking
*Please note that doors will be closing at 18:50.18:30 Introduction to GetYourGuide
18:40 Talk # 1: Fast & Asynchronous: Drift Your AI, Not Your GPU Bill
19:10 Break
19:40 Talk # 2: From Manual to LLMs: Scaling Product Categorization
20:15 Raffle (5 min) + Open Networking
21:00 End
ℹ️ The meetup begins at 18:00. Doors will remain open until 18:50, after which entry won’t be possible. We appreciate your understanding and look forward to welcoming you!
Answers for the curious:
Who should join the meetup?
This meetup is dedicated to anyone who works with, studies or is interested in ML and AI. It's a fun and informal environment where we can learn from each other's experiences.
What's the deadline to register for the event?
Please register by 18:00, November 12th.
Can I bring a plus one?
Sure, that's totally fine. Just ensure to register them as well.
Can I bring a dog?
Unfortunately, we don't allow dogs at this event.
For any questions, please don't hesitate to contact us.
Important note: Please be advised that this event will be recorded and photographed, and we will have a photographer on-site. If you prefer not to be included in any recordings or photographs, please do not hesitate to let us know during the event. Your comfort and privacy are important to us.