Publishing & Media
Editorial Research

By · Published · Updated

Inside METR's Assessment of Anthropic's AI R&D Acceleration

A step-by-step walkthrough of how independent researchers measured a ~2x speedup in AI capability development and what the evidence reveals about the pace of progress inside frontier labs.

Key Takeaways · Quick Answers
What is METR's assessment of Anthropic's AI R&D acceleration?
METR's assessment found that as of October 2026, Anthropic is likely improving the capabilities of its models on well-specified tasks at around twice the rate it did between March 2024 and October 2025. Benchmark scores measured via AECI have been growing at an estimated 1.9x the pre-October 2025 rate, with a 95 percent confidence interval of 1.5x to 2.8x. METR estimates that a majority of this acceleration is attributable to Anthropic's extensive use of AI to assist with its own R&D.
Who conducted the independent assessment of AI R&D at Anthropic?
The assessment was conducted by METR, a research organization focused on evaluating the pace and safety of AI development. The authors of the published report were Tom Cunningham, Nate Rush, Parker Whitfill, and Hjalmar Wijk. The evaluation ran from August 12 to October 29, 2026, during which METR staff performed a high-access evaluation at Anthropic with access to internal metrics, benchmark scores, AI speedup analyses, model forecasts, and staff interviews.
How much has Anthropic accelerated its AI R&D according to the assessment?
According to METR's measurement, Anthropic's AECI scores rose approximately 15 points per year before October 2025 and approximately 29 points per year after it, representing a 1.9x acceleration with a 95 percent confidence interval of 1.5x to 2.8x. METR placed the trend break on October 7, 2025. Alternative modeling assumptions yield a range of 1.1x to 2.9x. METR staff said they would not be surprised if the true acceleration was closer to 1.3x or 3x.
What does AI R&D acceleration mean for Anthropic's development trajectory?
The acceleration means Anthropic has made roughly two years of historical progress over the last year. METR found no evidence of significant bottlenecks that would prevent further capabilities progress due to limits on algorithmic progress, training compute, experiment compute, or data in the next 12 months. This creates a real risk that further capabilities progress could lead to even faster acceleration. The findings also have implications for Anthropic's Responsible Scaling Policy, which includes a 2x Acceleration Threshold that METR concluded Anthropic may plausibly have crossed.
Why did Anthropic redact evidence from the METR assessment?
Anthropic exercised its redaction rights to remove what it described as 'confidential information that could accelerate other AI developers.' METR reported that Anthropic redacted a majority of the evidence the organization found most informative for its conclusions about risk. METR disclosed this transparently and noted that the redactions make it hard for the public to judge the evidence themselves, reconcile it with other sources, and come to their own conclusions. The public web report summarizes a roughly 100-page private document without providing the unredacted underlying data.

Understand Why Independent Assessment of AI R&D Acceleration Matters

For years, the question of whether AI systems could start meaningfully accelerating their own development has lived mostly in the realm of speculation. Researchers at frontier labs spoke about it. Policy experts worried about it. But few had actually looked inside a major AI company to measure what was happening in real time.

That changed on November 5, 2026, when METR published its independent assessment of AI R&D acceleration at Anthropic. The report based on high-access evaluation conducted from August 12 to October 29, 2026 offered something unprecedented: direct measurement of whether AI is meaningfully speeding up the process of building more capable AI systems. The full METR assessment gives the public a rare window into what is happening inside one of the world's most consequential AI laboratories.

For anyone tracking AI development, evaluating Anthropic's IPO, or working on AI policy, understanding this assessment matters. Here is a step-by-step guide to what it found, how it worked, and what the evidence tells us about the pace of progress at the frontier.

Follow the Timeline of METR's High-Access Evaluation at Anthropic

The assessment did not happen overnight. METR staff spent roughly two and a half months embedded at Anthropic, examining internal data that outside researchers rarely see.

The timeline tells its own story:

  • August 12, 2026 METR staff begin high-access evaluation at Anthropic
  • October 29, 2026 On-site evaluation phase concludes
  • November 5, 2026 METR publishes its independent assessment publicly

During those weeks, METR researchers examined a range of internal data: metrics on pretraining and reinforcement learning, training compute in each domain, benchmark scores for internal models, AI speedup analyses, forecasts of a future model's metrics, and interviews with relevant Anthropic staff. This was not a surface review. Anthropic offered what METR described as "unprecedented access" to its AI R&D process.

The public web report summarizes a roughly 100-page private document. The authors Tom Cunningham, Nate Rush, Parker Whitfill, and Hjalmar Wijk acknowledged that the scope of information shared was broader than anything previously made available to external evaluators.

Measure the Acceleration Using AECI Benchmark Scores

At the center of METR's analysis sits the AECI, Anthropic's version of the Epoch Capabilities Index. This composite scale combines results from many AI benchmarks into a single capability score, giving researchers a way to track progress across different domains over time.

METR's measurement revealed a clear inflection point:

  • Before October 2025 Anthropic's AECI scores rose approximately 15 points per year
  • After October 2025 Scores rose approximately 29 points per year
  • The acceleration factor 1.9x the earlier rate

METR placed the trend break precisely on October 7, 2025. The 1.9x figure represents roughly two years of historical progress compressed into a single year.

The 95% confidence interval for this estimate spans 1.5x to 2.8x, and alternative modeling assumptions yield a range of 1.1x to 2.9x. This uncertainty is not a weakness of the study it reflects the genuine difficulty of measuring complex systems undergoing rapid change. The Kingy AI summary of METR's assessment explains that the interval excludes uncertainty over which models enter the analysis, meaning the true range could be even wider.

Distinguish the Rate of Change from the Level of Capability

It is important to understand what the 1.9x figure does and does not mean. As METR's report notes, a faster rate says the line is getting steeper under a particular measurement approach. It does not tell us how much useful work a model can do outside the benchmark, what an individual researcher saved in time, or how long the trend will last.

METR used a hypothetical to illustrate the distinction. Suppose implementation and review each initially take half a project's time. If implementation becomes four times faster but review stays the same, the total falls from one unit of time to 0.625 units. The project is 1.6 times faster overall, not four times faster. Real research workflows have many more moving parts, and their proportions can change in ways that make simple multiplication misleading.

Attribute the Acceleration to Its Likely Causes

METR went beyond measuring the acceleration to ask a harder question: what is driving it?

The assessment reached several conclusions about causation:

Compute scaling is not the explanation. METR stated it was confident that the acceleration was not due to an acceleration in the scaling of training compute. The faster progress was not simply a result of throwing more resources at the problem.

AI-assisted R&D appears to be the primary driver. The report estimated that a majority of the current acceleration is likely attributable to Anthropic's extensive use of AI to do R&D. In interviews and surveys, Anthropic staff self-reported dramatic uplift from use of AI systems in their work. METR authors subjectively attribute most current October acceleration to AI, perhaps around 80 percent but the report is careful to note that this uncertain share is not an 80 percent probability. Other causes likely played a large role in acceleration in late 2025.

The nature of AI contributions matters. METR was told that R&D is accelerated primarily via AI assistance rather than fully autonomous contributions. However, the report noted there are some signs that fully autonomous contributions will play a larger role soon.

What the Evidence Shows About AI's Role in Its Own Development

Anthropic has been transparent about its own use of AI systems to build future models. Anthropic's public measurements describe how AI systems are becoming exponentially more powerful and have begun to automate more of the process of building themselves. The company has stated that this process allows labs in democratic countries to develop more capable models more quickly and conduct more safety and testing on models before release.

Anthropic CEO Dario Amodei has called for coordination on pacing the frontier of AI development. The company has announced plans to embed independent third-party evaluators from multiple organizations at Anthropic, giving them access to internal processes, systems, and data comparable to what internal risk assessment teams have.

Examine What the 2x Acceleration Threshold Means for Anthropic

Anthropic's Responsible Scaling Policy, version 3.4 effective July 8, 2026, includes a specific provision addressing dramatic acceleration in AI progress. The policy defines a "2x Acceleration Threshold" that triggers when progress roughly doubles and the doubling is substantially attributable to automation of AI research.

In its August 2026 Risk Report, covering the period through July 15, Anthropic stated that acceleration was less than a factor of 2. METR's independent assessment reached a different conclusion. The eyeon.ai analysis of the assessment notes that METR called Anthropic's threshold defense "overstated." METR concluded that crossing the 2x threshold was plausible, with the 1.9x acceleration figure sitting close enough to the policy trigger to warrant careful attention.

As TechTimes reported, Anthropic's amended IPO filing says future models may imminently meet that same acceleration threshold. This timing adds practical weight to the measurement: investors and policy watchers are trying to understand whether Anthropic's own framework for managing dangerous capability development is being triggered.

Navigate the Evidence Anthropic Redacted

One of the most significant aspects of this assessment is what the public did not get to see. As part of the evaluation process, Anthropic had rights to redact any non-public information. METR's approach to transparency gave it the right to disclose whether Anthropic exercised redaction rights and whether any findings depended significantly on redacted information.

METR exercised that right. The redaction summary in the assessment makes clear that Anthropic redacted a majority of the evidence METR found most informative for its conclusions about risk. Anthropic described these redactions as "aimed at removing confidential information that could accelerate other AI developers."

The consequences are substantial. METR noted that much of the redacted evidence had multiple plausible interpretations, and both METR and Anthropic researchers have significant uncertainty about how to synthesize the evidence into a holistic picture. This makes it hard for the public to judge the evidence themselves, reconcile it with evidence from other sources, and come to their own conclusions.

"Much of the redacted evidence we viewed had multiple plausible interpretations, and both METR and Anthropic researchers have significant uncertainty about how to synthesize the evidence into a holistic picture. This makes it hard for the public to judge this evidence themselves, reconcile it with evidence from other sources, and come to their own conclusions." METR Independent Assessment

The public has to rely on METR's judgment much more than would be ideal, given the weight of the questions answered in the report. Some of the redactions are themselves challenging to describe clearly without revealing sensitive information METR was asked to redact. METR shared a table of important evidence it was and was not able to discuss given the redactions, but the full picture remains incomplete for outside observers.

Why the Redactions Create a Transparency Gap

The tension between METR's findings and Anthropic's redactions is not a simple story of concealment. Both parties have legitimate interests: Anthropic wants to protect genuinely sensitive information; METR wants the public to be able to evaluate the evidence independently.

The practical result is that readers of the public report are asked to trust METR's framing of the most important evidence rather than examining it directly. METR stated that all redactions important for its conclusions are covered by descriptions in its process section or other inline descriptions in the report, but the nuance and texture of the underlying data remains hidden.

Look at What Bottlenecks or Lack Thereof Suggest About Future Progress

One of the most consequential findings in METR's assessment concerns what might slow things down. The report states clearly: "We did not see evidence for significant bottlenecks which would prevent further capabilities progress due to limits on algorithmic progress, training compute, experiment compute, or data in the next 12 months."

This finding has direct implications for risk assessment. If AI systems started to significantly accelerate further AI development, METR noted, this could lead to a sudden emergence of extreme and risky capabilities. The absence of obvious bottlenecks means the conditions for further acceleration appear to exist.

METR acknowledged that its understanding of the status of different bottlenecks changed several times as the team received more detailed information. The organization is not confident in its current assessment of what might constrain future progress. This uncertainty cuts both ways: we cannot be sure bottlenecks exist, but we also cannot be sure they do not.

Consider What the Findings Mean for AI Policy and Oversight

This assessment arrives at a moment when the structures governing frontier AI development are still taking shape. Anthropic has proposed the Advanced AI Framework (AAIF), which includes rules for how any lab releases safe models, including transparency obligations that governments could require, such as risk reports.

Anthropic has stated that it plans to embed independent third-party evaluators from multiple organizations at its facilities, giving them access comparable to internal risk assessment teams. These third parties would verify safety practices, report incidents, and monitor key metrics. The METR assessment represents a version of what this kind of oversight might look like in practice.

The tension between transparency and confidentiality that runs through the report points to a broader challenge for AI governance. How do independent evaluators provide meaningful assurance without access so broad that it creates new risks? How do labs protect genuinely sensitive information while still giving the public enough visibility to judge whether safety frameworks are working?

What This Means for Anthropic, METR Readers

For readers following AI development as practitioners, investors, or policy researchers, the METR assessment offers several concrete takeaways. First, the measurement methodology used here tracking AECI scores over time, attributing causes, checking for bottlenecks represents a repeatable approach that could be applied to other frontier labs. The framework matters as much as the specific findings.

Second, the ~2x acceleration finding is a signal, not a verdict. The confidence intervals are wide, the redactions limit transparency, and the causal attribution involves significant uncertainty. Readers should treat the headline number as one input into a complex picture rather than a definitive diagnosis.

Third, the redaction controversy points to an ongoing tension in AI governance that will not resolve itself. The public needs enough information to evaluate whether labs are meeting their stated commitments, but labs have legitimate interests in protecting sensitive information. How this tension gets resolved will shape the credibility of future assessments.

Avoid Common Mistakes When Interpreting AI R&D Acceleration Findings

As this assessment circulates, several misinterpretations are likely to arise. Here is how to avoid them:

Mistake 1: Confusing Rate Acceleration with Capability Level

The 1.9x figure measures how fast Anthropic's benchmark scores are improving, not how capable its models are in absolute terms. A faster rate says the slope is steeper; it does not tell us where the line sits. Anthropic's most advanced internal model, called Model 4 in the report, earned an AECI score of 178.6 and scored above 50 percent on all 15 benchmarks METR examined. But METR noted that the shortage of benchmarks still difficult for Model 4 makes it "nervous" about measuring AECI now and in the future.

Mistake 2: Treating Attribution Estimates as Probabilities

METR subjectively attributed most current October acceleration to AI, perhaps around 80 percent. But the report explicitly states this uncertain share is not an 80 percent probability. Estimates of causation involve judgment calls that cannot be reduced to a single number with a confidence interval.

Mistake 3: Ignoring the Confidence Intervals

The headline 1.9x figure comes with a 95 percent confidence interval of 1.5x to 2.8x. Alternative assumptions yield 1.1x to 2.9x. Readers who treat the point estimate as precise are missing the genuine uncertainty in the measurement. METR staff themselves said they would not be surprised if the true acceleration was closer to 1.3x or 3x.

Mistake 4: Assuming the Trend Will Continue

The absence of observed bottlenecks does not guarantee their absence. METR acknowledged that it may be missing important bottlenecks. The finding is that no significant bottlenecks were visible given the available evidence not that none exist.

Mistake 5: Overlooking What the Redactions Hide

The most informative evidence for METR's risk conclusions was redacted. Any interpretation of the assessment should acknowledge that the public is not seeing the full picture. This is not a criticism of METR or Anthropic it is a structural feature of the current oversight landscape that readers should factor into their conclusions.

Where to Read Further

For readers who want to explore the primary sources directly, several resources are available:

These sources together give readers the full arc of the assessment, from METR's methodology to Anthropic's public response to the broader policy implications. Understanding this evidence requires engaging with all of them not just the headline numbers.

Sources reviewed

Atlas Research Network