Trivalley Meetup- ComplianceAware Finetuning

​Fine-tuning makes a model better at the task. It can also make it worse at the rules.

​This session shows how standard supervised fine-tuning quietly dismantles the safety

​behaviour a model learned in pre-training, then walks through Compliance-Aware Fine-Tuning

​(CAFT), which makes compliance a hard constraint inside the training objective rather than a

​filter on top of it. Closes with a live notebook that fine-tunes a model and measures the

​compliance drift as it happens.

​

​Agenda

​10:00 AM – 10:10 AM
Registration & Check-in

​10:10 AM – 10:20 AM
Welcome & Introduction

​10:20 AM – 11:30 AM

​Fine-Tuning Without Losing Compliance

• ​How supervised fine-tuning can cause safety and compliance drift

• ​Why task performance can improve while rule-following degrades

• ​Introduction to Compliance-Aware Fine-Tuning (CAFT)

• ​Incorporating compliance constraints directly into the training objective

• ​Hands-on Working Session: Fine-tune a model and measure compliance drift using a live notebook

• ​Q&A

​11:30 AM – 12:00 PM
Networking & Closing Conversations

​Please bring your laptop. This will be an interactive session with a hands-on working exercise.