Skip to content
Body of Knowledge · Techniques and Models

AI-assisted developer productivity

The effect of AI coding assistance on how fast and how well engineers work. A controlled experiment on a defined task found a large speed-up. A randomised trial with experienced developers working in their own mature repositories found a slowdown that the developers did not perceive. The effect depends on the work, the codebase and the engineer.

Evidence grade: contested Useful but disputed; the limits below say what is contested.

Use it when

Deciding whether and how to adopt AI assistance, and how to measure it. Measure in the team's own conditions, and never by self-report or by counting licences.

Where it stops working

The evidence is recent and mixed, and the studies measure different things. The honest position is that the effect has to be measured locally. What is not contested is that the tools change what review must establish, and bring risks that need governance.

Where the standard uses it

Sources

  • Joel Becker, Nate Rush, Elizabeth Barnes and David Rein (METR). Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity. METR (Model Evaluation and Threat Research), July 2025, 2025. In the bibliography
  • Sida Peng, Eirini Kalliamvakou, Peter Cihon and Mert Demirer. The Impact of AI on Developer Productivity: Evidence from GitHub Copilot. arXiv preprint 2302.06590, 2023. In the bibliography

Used alongside it

Engineering Management Academy. (2026). AI-assisted developer productivity. In Engineering Management Academy Body of Knowledge (Version 3.1, TEC.ai-assisted-developer-productivity). https://www.engineeringmanagement.academy/body-of-knowledge/techniques/ai-assisted-developer-productivity