Fulfilling your LLM Deployment dreams

​OWASP LA virtual session

Schedule:
5:00–5:30 PM — Networking / Chapter updates
5:30–6:30 PM — Aaron’s talk + Q&A
6:30–7:00 PM — Open discussion

TOPIC:Fulfilling your LLM Deployment dreams
Join us for a virtual session featuring Aaron Ansari, Managing Partner at Answer Consulting Inc., with insights into deploying LLMs in real world environments, followed by live Q&A and community discussion.

​ABSTRACT: As organizations rush to integrate Large Language Models (LLMs) into their core business processes, they face a critical dilemma: embrace the 66% productivity boost offered by generative AI or mitigate the serious risks of data exfiltration and "shadow AI". This session provides a dive into the technical foundations of a robust generative AI system, moving beyond basic chat interfaces to a comprehensive enterprise architecture.

​We will explore the flegdling LLM Stack, identifying critical trust boundaries between organizational tenants and the public internet. Attendees will learn:

• ​The Risk Landscape: An analysis of top threats including prompt injection (OWASP LLM01), insecure output handling, and training data poisoning.

• ​Architectural Defenses: How to implement Retrieval-Augmented Generation (RAG) to maintain data accuracy and avoid the security pitfalls of fine-tuning on sensitive PII.

• ​Data Governance: Strategies for applying fine-grained access controls and role-based accounting to vector databases to ensure that AI only serves information to authorized users.

• ​Operational Security: A "layered onion" approach to security, from model hyperparameter tuning to outer-layer rate limiting and semantic caching.

​Leave this session with a foundational framework for deploying AI that is not only innovative but also compliant, secure, and resilient.

​Thanks to our SPONSOR: Answer Consulting, Inc.
Your Solutions Starts with Answer.
Strategic Consulting That Delivers Results

​CODE OF CONDUCT
We hope you enjoy the event, we care deeply about inclusivity and diversity so that OWASP is a comfortable and welcoming community for everyone. Please reach out to one of our chapter leaders if you have any feedback/concerns or would like to speak to us, we take these matters very seriously. You can find out more about our policies here:
https://owasp.org/www-policy/operational/conferences-events.html#conference-and-event-anti-harassment-policy

​SPONSORSHIP Opportunities Available
*Vendors interested in sponsoring please send an email to [email protected]*