90/30 Club Reading: Can LLM Agents Discover? Evaluating Creativity on ML Engineering Tasks

​Come join us for a group discussion of "Can LLM Agents Discover? Evaluating Creativity on ML Engineering Tasks"

Paper link: https://www.alphaxiv.org/abs/2608.llm-agents-creativity-evaluation

Recent AI systems promise autonomous scientific discovery, claiming to discover algorithms and produce research papers, yet understanding whether they exhibit creativity, the capacity to produce solutions that are both novel and useful, remains an open question. We present a framework for evaluating multi-turn LLM research agents' creativity using ML engineering tasks as a testbed, through three dimensions: P-Creativity (psychological novelty: novel relative to the agent's own prior solutions within a run), H-Creativity (historical novelty: novel relative to the corpus of human solutions), and Usefulness (task performance).

Event Schedule:

​7pm-8pm: Quiet reading time, grab a snack and read! (optional)

​8pm-9pm: Group discussion about the paper 📝

​9pm-10pm: We have our space for a bit longer, stay to socialize or network!

​Our event is hosted within Mox SF, the gracious donors of the space where we will meet.