About
I'm a researcher at METR, trying to shine a flashlight to help us navigate the cliff's edge we're walking along with AI.
I think there's a very good chance that humanity is on track to create AI systems substantially smarter and more capable than us. We need to be really careful about this, because it's an open scientific question whether we can control such systems.
I'm most well-known for creating GPQA, a widely used AI capability benchmark. I've also done research on scalable oversight (i.e. trying to figure out how to supervise a system that's smarter or more capable than the supervisor), and I was one of the first few employees at Cohere, where I trained embedding models for semantic search.
Research highlights
-
2026
(METR) Frontier Risk Report (February to March 2026) -
2025
(METR) Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity -
2025
(METR) Measuring AI Ability to Complete Long Tasks -
2023
(NYU) GPQA: A Graduate-Level Google-Proof Q&A Benchmark -
2023
(NYU) Debate Helps Supervise Unreliable Experts
In the news
Writing & talks
Essays
7
Research
5