MLn Club (ML Reading Group) #10: A global workspace in language models
Welcome to Week 10: A global workspace in language models by Anthropic
How can we identify and understand the internal “workspace” where large language models integrate information, reason, and broadcast concepts across their networks?
Can mechanistic interpretability reveal whether LLMs develop functional equivalents of global information sharing found in cognitive architectures?
Anthropic’s Global Workspace research investigates whether large language models contain internal structures analogous to the global workspace theory of cognition—a framework proposing that intelligence emerges when specialized processes compete for access to a shared information space. By tracing how concepts and features propagate through model activations, the researchers identify patterns of information routing and representation sharing that resemble a distributed workspace.
Rather than treating models as opaque functions, this work attempts to map the internal communication pathways that support reasoning and abstraction. The findings suggest that advanced capabilities may emerge not from a single reasoning module, but from the interaction of many specialized representations that become globally available across the network. This provides a new lens for understanding scaling: as models grow, intelligence may depend not only on increasing parameter count, but on developing richer internal mechanisms for information integration, coordination, and reuse.
Join us at CASI for discussion at 8 pm, and (optional) quiet reading from 7 pm.
📖 Reading Recommendations, Questions, or Comments? Contact us here!
🔎 View past meeting notes here.
What's this?
A super warm group of folks discussing their favorite topics!
In the first half, we host an optional quiet reading space
In the second half, we have a discussion where people can talk about what they found interesting about the reading and ask questions about things they didn't understand
When/Where:
CMU AI Safety Initiative's Office, 201 Craig Street, right across the PNC bank. Look for the open door up the stairs.
8pm discussion, 7pm optional quiet reading time.
Here's how it usually goes:
7:00 PM — arrival and settling in
8:00 PM — introductions
8:10 PM — discussion time
9:00 PM — wrap up then open discussion
Who's it for?
People who've been wanting to read up on the latest papers in ML and other fields but just haven't been able to find the time/motivation.
Why:
We've been procrastinating too much on our readings, even though we have so much fun doing them. We know we're not alone in this and want to keep others accountable for learning more about what they're passionate about!
We've also met a ton of really fun friends by discussing what we care about!
Rules/guidelines on how to act:
Act like a host, include people in conversations, talk to people even if they're strangers, offer to explain what you know, and keep an open mind! come to read stuff and find super fun friends :)
Bring snacks if you're feeling kind!