GenAI Cracow #20
We are going back to our roots, this edition will be dedicated to RAG
This time due to restriction from our host, we had to modify the schedule. Please mind the new time for the start
Doors Open: 5:00 PM
Official Opening: 5:30 PM
Agenda
Intro
Opening Ceremony
The Importance of Routing in RAG Pipelines by Michał
RAG reality on edge by Hubert
Q&A
Quiz
Networking (sponsored by Sabre)
Abstract
The Importance of Routing in RAG Pipelines
Not every question sent to a RAG system actually needs context from a vector database. Adding a router to the pipeline can make the answers more accurate and at the same time cut costs by reducing the number of tokens used. It also gives the system more flexibility, for example by pulling in information from the web when needed.
RAG reality on edge
AG systems often look magical in demos… until someone actually tries to use them. This talk dives into why generic RAG pipelines tend to fall apart in production and why real-world solutions need a custom, domain-specific approach. We’ll walk through the experiments that failed and the methods that finally worked. The session also covers edge LLM deployment, because not everyone wants (or is allowed) to send their data to the cloud. We'll cover which open-source models can realistically run on local hardware, how to optimize them, and how these challenges are being tackled in our own product, Recordya, a packaged solution battling the “let’s host LLMs on-prem” reality
Speakers
Michał Żabiński
Software Engineer @ IBM watsanx.ai team & Undergraduate student @ AGH University of Science and Technology (Bachelor's degree in Geoinformatics). His academic background is complemented by prior studies in Graphic Design at the same institution. Michał is developing expertise in technical and geospatial sciences, positioning himself at the intersection of innovative technology and applied research within geoinformatics.
Hubert Bryłkowski
Lead Machine Learning Engineer @ nexocode, experienced in designing and deploying E2E machine learning solutions with a focus on MLOps, model optimization, and edge AI. He builds scalable training pipelines, real-time inference systems, and integrates ML models into production environments across both cloud and embedded platforms. Beyond his professional work, Hubert is passionate about all kinds of DIY projects, 3D printing, and experimenting with new technologies, exploring how to bring ideas to life in digital and physical worlds
Sponsors
Sabre Poland
Krakow office is a leading research and development center supporting the global travel and tourism sector. Around 1,200 professionals in Krakow focus on building and maintaining advanced software for airlines, hotels, and travel agencies worldwide. Their expertise encompasses designing and developing mission-critical applications, innovative reservation systems, and industry-leading travel technology products that serve millions of customers each day.