![Cover Image for [hybrid] Evaluating LLM based applications](https://images.lumacdn.com/cdn-cgi/image/format=auto,fit=cover,dpr=2,background=white,quality=75,width=400,height=400/event-covers/ea/c0639248-60dc-4120-89b5-b73ca25acf9a)
[hybrid] Evaluating LLM based applications
🙋♀️Join us for an exclusive workshop with Una Galyeva, visiting us all the way from PyLadies Amsterdam!
It is so easy to build a PoC using LLMs and it is so hard to turn it into a production-grade LLM application. To succeed you should have a robust evaluation framework during development and post-deployment, not to mention its automation as manual reviews usually do not scale. This workshop focuses on LLM evaluation automation powered by Python open-source libraries. We start with the exploration of different evaluation techniques. Further, we incorporate them into our test suite. At last, we lay the foundation for the monitoring.
With over 19 years of experience in Data and AI, Una held various positions, from hands-on development to leading data and AI teams. As a driving force behind PyLadies Amsterdam and a Microsoft MVP, Una is passionate about challenging perspectives and inspiring others to see things differently.
🤔 Before the session
Make sure to check you have everything needed setup prior to the event:
https://github.com/pyladiesams/eval-llm-based-apps-jan2025?tab=readme-ov-file#requirements
📹 the event will be streamed
🚨 https://youtube.com/live/phpQ5hmC08E?feature=share
📆 Agenda
18h00 Doors open & Community Announcements
18h15 Workshop Kickoff
20h15 Networking
*Snacks and drinks will be provided by our sponsor MOIA, we will accommodate folks' needs but if you require something specific you are also welcome to bring along your own food and drinks.
❓ Can men attend ❓
Everyone is welcome. :)
If you identify as someone well-represented in open source and in tech, please be mindful of the space and privileges you have, and use it to support others.
🗣️ To include a multitude of perspectives, the spoken language of this meetup will be English.
🤝 By attending our event, you agree to the PyLadies Code of Conduct: https://www.pyladies.com/CodeOfConduct/ and the LadyNerds Code of Conduct: http://bit.ly/LadyNerds-CoC
📧 Contact
Are you interested in speaking at one of our events? Have a good idea for a Meetup? Get in touch with us at hamburg@pyladies.com
💬 Find us on the PyLadies Global workspace:
https://slackin.pyladies.com enter your email address.
Accept the email invitationGo to workspace https://pyladies.slack.com
Join channel #city-hamburg, #germany, #jobs-europe, #city-amsterdam