Accelerating Frontier AI: The Compute Crisis is a Reinforcement Learning Problem
DeepAI San Francisco
Frontier AI has a compute problem. As models grow larger and training runs become increasingly expensive, the industry’s appetite for compute continues to outpace supply. Building ever-larger AI data centres is one answer, but what if we could make dramatically better use of the compute we already have?
This event focuses on a very different approach to the problem: using reinforcement learning, the field built for sequential decision-making, to design more efficient infrastructure and to squeeze more from the compute we already have, at every layer of the stack.
RL agents already design chip floorplans, generate and tune GPU kernels, control the cooling of gigawatt-scale AI factories, and are now starting to optimise the training process itself.
But where does this go next?
As frontier AI systems become increasingly autonomous, will they uncover entirely new opportunities for optimisation? How should recent thinking on continual learning influence the design of tomorrow’s training infrastructure? And if the compute crisis is a reinforcement learning problem, just how much of the stack can RL eventually optimise?
Join us at AWS Builder Loft for an evening of talks with researchers and founders applying RL across the compute stack, from silicon to schedulers, and a social hour with the RL and frontier AI community. Following our London edition at Amazon's HQ, this is the second event in the DeepAI series.
Agenda
5:00 – 5:45 — Doors open, arrivals & refreshments
5:45 – 6:00 — Introductory remarks from AWS
6:00 – 6:15 — Paramorph: accelerating training with online hyper-parameter control
6:15 – 6:30 — Metrana: tracking RL and world model experiments at scale
6:30 – 6:50 — InstaDeep: RL to optimise printed circuit board design
6:50 – 8:00 — Networking with refreshments provided by our hosts at AWS
Who this is for
Researchers and engineers in reinforcement learning, foundation model training, and AI compute infrastructure; and anyone whose GPU bill keeps them up at night.
Venue
The Loft (AWS Builder Loft), San Francisco. Refreshments kindly provided by Amazon Web Services.
NOTE: All attendees MUST bring a valid government-issued ID (e.g. driver's license, passport card, passport) to present at check-in. This is mandatory with no exceptions. All guests must be 18+. Scooters and bikes are not permitted in any Amazon building with no on-site parking available.
Pre-check-in on the AWS Builder Loft event space for smooth check-in: https://events.builder.aws.com/NAOVwB