#assessment

Linkpost to METR’s Anthropic Speedup Assessment

TLDR: roughly a 2x speedup, with a range of 1.3-3x. Model 4 looks very scary. https://metr.org/blog/2026-11-05-anthropic-ai-rd-acceleration-assessment/ Discuss

LessWrong · EN

METR: Independent Assessment of AI R&D Acceleration at Anthropic in October 2026

Executive summary From August 12 to October 29, 2026, METR staff performed a high-access evaluation at Anthropic to assess the degree to which AI is accelerating AI R&D. If AI systems started to significantly accelerate further AI development, this could lead to a sudden emergence of extreme and risky capabilities . Anthropic offered unprecedented access to internal data on their AI R&D process, including a variety of metrics on pretraining, reinforcement learning (RL), training compute in each domain, benchmark scores for internal models, AI speedup analyses, forecasts of a future model’s met

LessWrong · EN

Beyond Chatbots: We’re Writing Policies About the Wrong Thing

Schools are still writing policy for 2023 chatbots. Large language models make a poor go-between for two people and a very good interface between a person and a computer.

Dr Leon Furze · EN