VAM! AI Reading Group: Paper 'Aligning Audio-Visual Joint Representations with an Agentic Workflow'

​Presenter: Safak Atakan

​📄 Paper: Aligning Audio-Visual Joint Representations with an Agentic Workflow
https://arxiv.org/pdf/2410.23230

​To maximize engagement, please try to read the paper in advance.

​Paper 3-line Summary: The paper introduces AVAgent, an LLM-based agentic workflow that improves audio-visual (AV) representation learning by aligning audio signals with visual data.
It detects and corrects misaligned or noisy audio through iterative tool use, planning, and reflection cycles, refining the data quality itself. Experiments show that this alignment-centric, data-driven approach significantly enhances performance across multiple AV downstream tasks.

​Want to present?

​The list of papers will be available here: https://docs.google.com/spreadsheets/d/1HET5sjnHjwiF3IaCTipR_ZWspfgglqwdBFRWAfKBhp8/edit?usp=sharing

​To connect with the group, join the Discord: https://discord.gg/teJvEejs94

​Timeline:
🕠 6:30 PM – Arrival & Networking.

​🗣️ 6:45 PM ~ 7:15 – Paper Presentation

​🗣️ 7:15 PM - Discussions

​About the Facilitator

​Issam Laradji is a Research Scientist at ServiceNow and an Adjunct Professor at University of British Columbia. He holds a PhD in Computer Science and a PhD from the University of British Columbia, and his research interests include natural language processing, computer vision, and large-scale optimization.

​Looking forward to discussing the latest AI Papers!