Talk to us
Menu
← Insights

Insight · AI ROI

AI Productivity Metrics: Why Time Saved Is Not ROI

Skein28 October 20267 min read

Time saved is the most popular way to measure AI and one of the least reliable. People misjudge their own savings, and an hour saved creates value only if it is spent on something that matters. Better AI productivity metrics track outcomes the business already records: time to finished work, rework, pipeline and cost per result.

Key takeaways

  • Hours saved measure capacity, not value; the value is whatever the freed hour produces.
  • According to METR's 2025 trial, experienced developers took 19% longer with AI tools while believing AI had made them 20% faster.
  • Leaders feel the gap: 59% worry about quantifying AI's productivity gains, according to Microsoft and LinkedIn.
  • According to McKinsey, only 39% of organisations report enterprise-level earnings impact from AI, despite widespread use.
  • Measure end-to-end time to approved work, rework rates and business outcomes instead of asking people how much time they saved.

Is time saved a good measure of AI ROI?

Not on its own. Time saved tells you AI freed up capacity. It does not tell you whether that capacity produced anything. If a saved hour goes into more sales calls, there is a return. If it goes into more email, there is none. Time saved is a starting point for measurement, not the answer.

Time saved is popular because it is easy. Ask people how long a task used to take and how long it takes now, multiply by an hourly rate, and you have a number for the board. The trouble is that the number measures a feeling about effort. It does not measure what changed in the business.

That gap shows up at scale. According to McKinsey's 2025 State of AI survey, 88% of organisations use AI in at least one function, but only 39% report any earnings impact at the enterprise level. If time savings were turning into value automatically, those two numbers would sit much closer together.

Why are self-reported time savings unreliable?

Because people are poor judges of their own speed, and AI makes them feel faster. Drafting feels effortless, while the checking, correcting and rework that follow are easy to forget. In one controlled study, people who were slower with AI still believed it had sped them up.

The clearest evidence comes from METR, a research group that ran a randomised trial in early 2025. Sixteen experienced open-source developers worked on 246 real tasks, some with AI tools allowed and some without. With AI, they took 19% longer. Before starting, they had predicted a 24% speed-up. Afterwards, they still estimated AI had made them 20% faster.

The authors are careful about what this shows. It was one setting, with early-2025 tools and experienced people working on code they knew well. They have since published updated data on newer tools. However, the gap between perception and measurement is the lesson that travels. If skilled people can be wrong about the direction of the effect, a survey asking "how much time did AI save you?" cannot be trusted as a return figure.

When does time saved become real value?

Time saved becomes value when three things are true. First, the freed time is redirected to a named activity. Second, that activity is measured against a business number. Third, there is a baseline from before AI to compare with. Miss any one, and the saving is a claim rather than a result.

Consider two salespeople who each save three hours a week on call notes and follow-ups.

The first spends the time on more outreach. Her meetings booked rise, and the CRM shows it. That saving has a value: the pipeline those meetings produce.

The second spends the time catching up on admin that was already overdue. The work still matters, but nothing measurable changes. On paper both saved three hours. Only one produced a return you can show.

Neither salesperson did anything wrong. The difference is whether the business decided in advance where saved time should go and how to measure it.

What should you measure instead of time saved?

Measure outcomes the business already records. Useful AI productivity metrics include end-to-end time from request to approved work, the rework rate on AI drafts, output per person on a defined job, and the business result the work feeds, such as meetings booked, pipeline or cost per lead.

Instead ofMeasureWhy it is better
Hours saved, self-reportedTime from request to approved workIncludes checking and rework, from a system log
"AI drafts written"Share of drafts used with light editsShows whether output is trusted
Log-ins and promptsWorkflows running weekly, by teamShows use built into work, not dabbling
Productivity gain, estimatedBusiness result per workflowPipeline, cost per lead, deals, response time

The first row matters most. End-to-end time captures everything: the fast draft, the slow review and the rewrite. It is the honest version of time saved. The guide to time to first draft explains how to record it.

Leaders feel the measurement problem keenly. According to Microsoft and LinkedIn's 2024 Work Trend Index, 59% of leaders are concerned about quantifying the productivity gains from AI. Better metrics answer that concern with data rather than estimates.

How do you track AI productivity without a data team?

Pick one workflow per team, choose one outcome measure that already lives in a system, record it for a few weeks before and after AI, and decide where saved time should go before you start. A spreadsheet and a monthly check are enough. Precision matters less than measuring the same thing the same way.

A light process that works:

  1. Name the workflow. For instance, "weekly client report" or "post-demo follow-up".
  2. Pick the measure. Use something a system already records, such as timestamps in a project tool or meetings in the CRM.
  3. Decide where saved time goes. Write it down: more outreach, faster delivery, a backlog cleared.
  4. Record four weeks before and eight after. Same people, same measure.
  5. Review monthly. Keep what moved the number, change what did not.

This also protects against a quieter risk. When AI is measured only by time saved, the incentive is to produce more drafts, faster, whether or not anyone uses them. Measuring outcomes keeps the focus on work that matters. The broader framework is in the guide to measuring AI ROI.

Workflows that report their own results make this far easier, because the timestamps and outcomes are captured as the work runs. Skein builds workflows that way, tracking measures such as pipeline, cost per lead and time to first draft; the outcomes page lists what is measured. That suits a business that wants AI judged on business numbers. A team using AI lightly for writing help may find a monthly spot check is plenty.

Frequently asked questions

Why is time saved not a good AI metric?

Time saved measures freed capacity, not value. It is usually self-reported, and people misjudge their own speed with AI. A saved hour only creates a return if it is spent on something measured, such as more sales activity or faster delivery. Outcome measures from business systems are more reliable.

What are the best metrics for AI productivity?

The most reliable are end-to-end time from request to approved work, the share of AI drafts used with light edits, the number of workflows running weekly by team, and the business result each workflow feeds, such as meetings booked, pipeline or cost per lead.

Do AI tools actually make people more productive?

Often, but not always, and perception is a poor guide. METR's 2025 randomised trial found experienced developers took 19% longer with AI tools while believing they were faster. Results vary by task, tool and experience, which is why measuring outcomes beats assuming a gain.

How do you measure the impact of AI on employees?

Measure the work, not the feeling. Track end-to-end time on defined jobs, rework on AI output, quality measures such as error rates, and the business results the work feeds. Add a short pulse survey on confidence and workload, but do not treat self-reported time savings as the return figure.

How do you turn AI time savings into ROI?

Decide in advance where saved time should go, measure that activity against a business number, and compare it with a baseline recorded before AI. For example, if salespeople save time on notes, track whether meetings booked rise. The return is the value of that extra activity.

Sources
  1. METR. "Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity." METR, 10 July 2025. https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/
  2. Microsoft and LinkedIn. "2024 Work Trend Index." Microsoft, 8 May 2024. https://blogs.microsoft.com/blog/2024/05/08/microsoft-and-linkedin-release-the-2024-work-trend-index-on-the-state-of-ai-at-work/
  3. McKinsey. "The state of AI in 2025: Agents, innovation, and transformation." McKinsey, November 2025. https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai

Talk to us

Find out where AI pays in your business.

Thirty minutes, with the person who would do the work. You leave with the two or three places we would start, whether or not we work together.