Checking the checkers: AI, Evidence and Health Claims (w/ The AI Collective)
Checking the checkers: AI, Evidence and Health Claims
An AI Collective Sweden Chapter Research Discussion & Interactive Workshop
Featuring Lola Phoenix
AI chatbots are increasingly becoming a source of health information. But what happens when misinformation is hidden inside an ordinary question? Do AI systems challenge misleading claims, reinforce them, or simply go along with them?
Join The AI Collective for an engaging discussion and hands-on workshop with Lola Phoenix, who will introduce her independent research into how popular AI chatbots handle health misinformation.
About the research
Lola's study examines how ChatGPT, Gemini, Claude and Perplexity respond to misleading health claims embedded in everyday requests.
For example:
Asking for a juice cleanse to "flush toxins from the liver".
Looking for raw milk suppliers based on the claim that pasteurisation removes nutrients.
The research tested ten scenarios, each repeated ten times, alongside matching requests without misinformation, generating 800 AI responses. Google and Bing's AI-generated answers were also included for comparison.
What to expect
1. Discover the research
Lola will walk us through the study, its methodology and the questions behind the research.
2. Explore real AI responses
Look at real examples and discuss how different AI systems respond to misleading health claims.
3. Take part in an interactive workshop
Learn how the research evaluates AI responses and try the purpose-built evaluation app yourself. Attendees will have the opportunity to participate as volunteer coders, reviewing anonymised responses without knowing which AI tool generated them.
4. Explore responsible AI research
We'll also explore tools such as Consensus and discuss how to verify health information and critically evaluate AI-generated answers.
Who should attend?
AI enthusiasts, students, researchers, healthcare professionals, developers and anyone curious about AI, health misinformation and responsible technology.
No previous research or technical experience is required. Just bring your curiosity and willingness to participate!
Why join?
AI is changing how people access and interpret health information. Understanding whether these systems can recognise and challenge misinformation is an important part of building a more trustworthy AI future.
This is an opportunity not only to learn about independent research but also to contribute to it.
Come curious. Question AI. Help build a more trustworthy future.
AI chatbots are increasingly becoming a source of health information. But what happens when misinformation is hidden inside an ordinary question? Do AI systems challenge misleading claims, reinforce them, or simply go along with them?
Join The AI Collective for an engaging discussion and hands-on workshop with Lola Phoenix, who will introduce her independent research into how popular AI chatbots handle health misinformation.
About the research
Lola's study examines how ChatGPT, Gemini, Claude and Perplexity respond to misleading health claims embedded in everyday requests.
For example:
Asking for a juice cleanse to "flush toxins from the liver".
Looking for raw milk suppliers based on the claim that pasteurisation removes nutrients.
The research tested ten scenarios, each repeated ten times, alongside matching requests without misinformation, generating 800 AI responses. Google and Bing's AI-generated answers were also included for comparison.
What to expect?
1. Discover the research
Lola will walk us through the study, its methodology and the questions behind the research.
2. Explore real AI responses
Look at real examples and discuss how different AI systems respond to misleading health claims.
3. Take part in an interactive workshop
Learn how the research evaluates AI responses and try the purpose-built evaluation app yourself. Attendees will have the opportunity to participate as volunteer coders, reviewing anonymised responses without knowing which AI tool generated them.
4. Explore responsible AI research
We'll also explore tools such as Consensus and discuss how to verify health information and critically evaluate AI-generated answers.
Who should attend?
AI enthusiasts, students, researchers, healthcare professionals, developers and anyone curious about AI, health misinformation and responsible technology.
No previous research or technical experience is required. Just bring your curiosity and willingness to participate!
Why join?
AI is changing how people access and interpret health information. Understanding whether these systems can recognise and challenge misinformation is an important part of building a more trustworthy AI future.
This is an opportunity not only to learn about independent research but also to contribute to it.
Come curious. Question AI. Help build a more trustworthy future.
Hosted by The AI Collective
As always, food and drink, engaging conversation, and incredible company will all be provided!
Please be advised: Unfortunately, space is very limited at these community events and we can not always accept everyone we would like to. If you are not accepted to this event, please keep applying! We appreciate your application tremendously and we are looking forward to seeing you at a future event very soon!
The AI Collective is a global non-profit building the human layer for the AI era. We unite 200,000+ leaders, builders, and stakeholders across 100+ forums worldwide to democratize the frontier, build trust, and coordinate how society navigates the rapid acceleration of technological progress.
All attendees and organizers at events affiliated with The AI Collective agree to our privacy policy and are subject to our code of conduct.