How Teams Can Measure The Payoff From AI Coding
AIThis post was created with the assistance of artificial intelligence (AI).

🔍 Read the full analysis: How Teams Can Measure The Payoff From AI Coding on ThorstenMeyerAI.com

Before you orderOffer from Amazon

Get everyday essentials delivered free with Prime

  • Fast, free delivery on millions of items
  • Prime Video, Amazon Music and more included
  • Member-only deals all year
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

TL;DR

A survey of engineering leaders at 27 workplaces found AI coding budgets ranging from $150 to about $3,000 per developer per month, with no consistent measure of return. Reported output gains vary widely, so the article argues teams should track accepted changes, rework and delivery outcomes rather than tool usage alone.

Engineering teams are setting 2027 budgets for AI coding tools without a reliable way to show what the spending delivers, according to an October 20 report by Gergely Orosz of The Pragmatic Engineer. Interviews across 27 workplaces found monthly spending from $150 to about $3,000 per developer, while reported productivity outcomes ranged from flat pull-request counts to substantial increases.

The findings arrive as some companies face higher bills when discounted subscriptions expire and usage-based pricing makes AI tool consumption more visible. Orosz reported that API-plan spending at some companies peaked in June and July and had roughly halved since, which he attributed to the release of Opus 5.5 and a shift toward open models. The report also said spending caps are common but can be bypassed.

Measures of output do not tell a consistent story. CodeRabbit, an AI code-review vendor, said pull requests created on its platform rose 113% year over year. Microsoft researchers studying tens of thousands of engineers during an early-2026 rollout of Claude Code and GitHub Copilot CLI found adopters merged about 24% more pull requests over four months than they otherwise would have. Microsoft’s authors cautioned that a merged pull request does not necessarily equal delivered value.

Companies in Orosz’s survey reported outcomes ranging from unchanged pull-request frequency to five- or tenfold increases, though the report describes individual company examples rather than a common controlled measure. One company saw pull requests become three times larger while their frequency stayed flat. The article recommends tracking cost per accepted change, rework, change-failure rates and stories closed compared with stories added, rather than treating tokens or pull-request volume as proof of return.

At a glance
reportWhen: Published October 23, 2026; survey find…
The developmentAn October 20 survey of 27 workplaces highlighted wide variation in AI coding costs and results as companies set budgets for 2027.
Thorsten Meyer AI
AI coding budgets · Oct 2026

Infographic 01 · Where the money goes

From a $150 cap to $3,000 a month per developer.

Anecdotal data from 27 workplaces, mostly anonymized. It shows how wide the range is, not an industry average.

27workplaces interviewed by The Pragmatic Engineer
$150–3Kmonthly AI budget per developer across the sample
16×quant firm’s total AI spend, January → September
5–10×bill increase some expect when subsidized plans end

Spend per developer per month

Examples from the free part of the article · scale to $4,000

  • Public company, 1,500 engineersmonthly cap per developer$150 cap
  • Quant trading firm, Januaryaverage per developer~$80
  • Quant trading firm, Septemberaverage per developer · total $8M/month$1,600
  • Public company, 5,000 stafftypical backend engineer · $1,000 soft cap~$1,500
  • Same company, team leads / Staff+typical spend~$2,500
  • AI SaaS, ~100 staffallowance, treated as a hard cap$2,000 cap
  • Two-person .NET agency (EU)actual spend per developer~$3,000
  • Multinational, 10K+ staffhard cap · average feels like ~$1,000$4,000 cap

actual or typical spendbudget cap

What changed in 2026

Why the 2027 budget needs a range

  • Peak in June and July: spend has roughly halved since for companies on API plans (Opus 5.5 and open models).
  • Caps are common at medium and high spenders, and most people say they are easy to get around.
  • Subsidies are ending: some companies must optimize or see the bill rise 5–10×.
  • GitHub Copilot bills by token since 1 June 2026, at each model’s API rate, with no fallback to a cheaper model.
  • Company size does not predict spend.

ROI is “a question that few companies seem able to answer – at least for now.”Gergely Orosz, The Pragmatic Engineer, 20 Oct 2026

Sources: The Pragmatic Engineer, “What’s the ROI of software engineers’ spending on AI?” (20 Oct 2026, free part); GitHub (27 Apr 2026).
Powered by Thorsten Meyer AI

Budgets Need Delivery Measures

For engineering leaders, the difference between tool activity and useful output can shape whether AI spending is renewed, capped or expanded. A higher count of generated code or merged changes may not mean customers receive improvements faster if work creates extra review, rework or security risk.

The article points to Veracode testing in which 44% of AI coding tasks produced a known vulnerability. That figure makes review and security outcomes relevant parts of any assessment, alongside speed and cost. It does not establish that all AI-generated code is vulnerable, but it cautions against measuring payoff through volume alone.

A practical measurement approach should compare similar work over a defined period and include both engineering effort and delivery quality. Cost per accepted change, the amount of rework and whether teams close more work than enters the backlog can help distinguish productivity gains from increased code production. The supplied report does not establish a single benchmark that applies across companies.

Amazon

AI coding productivity tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Results Depend on the Work

The examples in the report suggest AI tools can help most with bounded tasks and consistent technology stacks. At a SaaS company with about 600 engineers, overall merged-pull-request velocity barely changed, but a staff engineer described faster customer-issue triage, code-history research and prototyping. These are reported experiences, not a controlled estimate of company-wide savings.

Ix Technologies, a two-person European agency using C# and Blazor, said it spends about $3,000 per developer each month and uses AI to clear a long-standing backlog. Cofounder Rogier van der Hee said the pair felt they could do the work of five to seven people before AI. A multinational team cited in the report said it now closes three times as many user stories each month, for the first time exceeding the number of stories coming in.

Research results also vary. METR’s early-2025 study found experienced open-source developers took 19% longer with AI. A February follow-up estimated an 18% speedup for returning developers and 4% for new developers, but the confidence intervals included zero. METR said the results were unreliable in part because participants held back tasks they did not want to do without AI. The different studies use different populations, tasks and measures, so their numbers are not direct comparisons.

““a question that few companies seem able to answer – at least for now.””

— The Pragmatic Engineer report, citing its author Gergely Orosz

Amazon

code review AI software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

No Shared ROI Benchmark Yet

The available figures do not establish how much AI coding improves productivity across the industry. Vendor platform data, company reports, controlled studies and self-reported estimates measure different things. The survey’s company examples also do not show that the same results would follow from adopting the same tools elsewhere.

It remains unclear how much reported output gains translate into faster customer delivery after accounting for review, defects, security work and maintenance. The source article also does not provide a standard methodology for comparing spending or outcomes across the 27 workplaces. Its quoted 44% vulnerability result refers to Veracode’s test of AI coding tasks; it should not be read as the share of all AI-generated code that contains a vulnerability.

Amazon

developer rework tracking software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Companies Set Their 2027 Metrics

Companies facing the end of discounted subscriptions or higher usage-based charges will need to decide whether to renew, cap or change their AI coding budgets. The report points toward measuring outcomes at the level of accepted changes and completed work, while tracking rework and failures so that faster code production is not mistaken for better delivery.

The next useful evidence will come from teams comparing these measures over time and sharing how they account for task complexity, code quality and security. No common industry standard or broadly accepted ROI figure is established in the source material, so budget decisions remain tied to each company’s own work and results.

Amazon

AI project management tools for developers

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Questions

How much are companies spending on AI coding tools?

The October 20 report found budgets ranging from $150 to about $3,000 per developer per month across the workplaces surveyed. Those figures are examples from 27 workplaces, not an industry-wide average.

What measures can teams use to evaluate AI coding?

The source recommends tracking cost per accepted change, rework, change-failure rates and user stories closed compared with stories entering the backlog. These measures focus on delivery and quality rather than tool consumption alone.

Do studies agree that AI coding makes developers faster?

No. Reported results differ by study and task. Microsoft researchers reported about 24% more merged pull requests among adopters over four months, while METR’s estimates varied and had confidence intervals that included zero in its February follow-up.

Where did companies report clearer benefits?

Examples in the report include customer-issue triage, tracing the history of code, prototyping and backlog work on relatively uniform technology stacks. These are company-reported cases, not proof that every team will see the same gains.

Does the 44% vulnerability figure apply to all AI-written code?

No. It refers to Veracode’s test, in which 44% of AI coding tasks produced a known vulnerability. The source does not say that 44% of all AI-generated code is vulnerable.

Source: ThorstenMeyerAI.com

HALLOWEEN

Halloween Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

Why Shipping Rooms Still Rely on Dedicated Label Printers

Discover the top label printers for shipping rooms in 2026. Find the best options for small businesses, ease of use, value, and high-volume shipping needs.

Why Micro‑AI Startups Are Outpacing Tech Titans in Niche Markets

Discover how micro‑AI startups’ agility, personalization, and edge computing are enabling them to outpace tech giants in niche markets and what this means for the future.

Could Stripe And Advent’s Offer Reshape The PayPal Market? Market Signals Say Yes

Market signals indicate Stripe and Advent have made a joint offer to acquire PayPal, potentially reshaping the digital payments landscape.

An AI Exit Assistant To Help You Review Coverage Before Resigning

An IdeaNavigator AI proposal outlines a tool that compares resignation dates against equity, bonuses, retirement matches, insurance and PTO rules.