Talk to us
Menu
← Insights

Insight · Problems with AI

AI Pilot Purgatory: Why Pilots Never Reach the Rest of the Business

Skein30 October 20267 min read

AI pilot purgatory is when a pilot neither succeeds nor stops: it keeps running in a corner, with no decision about whether to roll it out. It happens when nobody owns the decision, there is no agreed measure, or the pilot was built around a tool. Design every pilot to end in a decision, on a date, against a number.

Key takeaways

  • Purgatory is not failure; it is the absence of a decision about a pilot.
  • According to Gartner, at least 30% of generative AI projects would be abandoned after proof of concept by the end of 2025.
  • According to MIT NANDA, only 5% of custom enterprise AI tools reached production.
  • Pilots escape purgatory when they have an owner, a measure, a baseline and an end date set before they start.
  • Moving a pilot into everyday work needs written methods, shared knowledge and training, not just a working demo.

What is AI pilot purgatory?

AI pilot purgatory describes AI projects that stay in trial mode indefinitely. They work well enough that nobody stops them, but nobody commits to rolling them out either. One enthusiast uses the tool, a few colleagues try it, and a year later it is still "the pilot", with no plan to scale it or end it.

The distinction matters. A pilot that is evaluated and stopped has done its job: it produced a decision. Purgatory is different. It consumes attention and budget while teaching the business nothing it acts on.

The pattern is common. According to Gartner, at least 30% of generative AI projects would be abandoned after proof of concept by the end of 2025, because of poor data, weak risk controls, rising costs or unclear value. MIT NANDA's 2025 study found only 5% of custom enterprise AI tools reached production.

Why do AI pilots stall?

AI pilots stall for four common reasons: nobody owns the decision to scale or stop, success was never defined, the pilot was built around a tool rather than a real job, and rolling it out would require work nobody planned. Technology is rarely the reason.

No decision owner. An enthusiast built it; a manager approved trying it; nobody is accountable for deciding what happens next.

No measure. Without a baseline and a target agreed upfront, every result is ambiguous, so nobody can argue for or against it.

Tool-first thinking. "Let's try this AI tool" produces a demo. "Let's halve the time to produce the weekly report" produces a decision.

Hidden rollout work. A pilot run by one expert works because that expert knows everything. Scaling it means writing down the method and the knowledge, which nobody budgeted for.

Definitions of success can be strict, too. MIT NANDA counted success as deployment beyond pilot with measurable results six months later. By that standard, many promising pilots never qualify, because nobody set up the measurement.

How do you design an AI pilot that ends in a decision?

Before starting, agree five things: the job it will change, the measure, the baseline, the owner who decides, and the date the decision is made. Then run it on real work with real users. On the date, the owner chooses to expand, adjust once or stop, and records why.

Agree before startingExample
JobDrafting the weekly client report
MeasureHours from data available to approved report
BaselineFour weeks of current timings
OwnerHead of client services
Decision dateEight weeks after launch

A pilot with these five decided is hard to leave in limbo. When the date arrives, there is a number, a person and a meeting. The guide to measuring AI ROI covers choosing the measure.

How do you move a pilot into everyday work?

Write down how the pilot works so others can follow it, put the knowledge it relies on into shared files, train the people who will use it on their own tasks, set the approval point, and assign ongoing ownership. A pilot proves an idea; a written workflow is what lets the rest of the business use it.

The gap between pilot and practice is mostly knowledge. In the pilot, the expert carried the context in their head: which data to trust, which caveats to add, what good looks like. Scaling means moving that context into shared files and written methods, so a new user's AI starts from the same place.

Adoption at scale is still the exception. According to McKinsey's 2025 State of AI survey, 88% of organisations use AI in at least one function, but only about a third have begun scaling it across the enterprise.

The shared files are what a company brain holds.

When should you stop an AI pilot?

Stop a pilot when it misses its measure after a fair trial, when the cost of checking its output erases the time saved, when nobody will take ownership of rolling it out, or when the job it changes turns out not to matter. Stopping is a success if it is a decision, recorded with the reason.

Record what was learned. A stopped pilot often reveals a missing ingredient, such as data nobody keeps or a method nobody wrote down. That lesson is valuable for the next pilot.

If you want help choosing pilots worth running, Skein's fixed-scope AI strategy diagnostic ranks opportunities and ends in a 90-day plan with owners and measures. That suits a business with several stalled experiments and no clear next step. A business with one working pilot may only need to set its decision date.

Frequently asked questions

What is AI pilot purgatory?

AI pilot purgatory is when an AI pilot keeps running without anyone deciding to roll it out or stop it. It usually happens because no one owns the decision, success was never defined, or scaling would require work nobody planned. It wastes attention and teaches the business little.

Why do most AI pilots fail to scale?

Most stall for business reasons: no decision owner, no agreed measure, a pilot built around a tool rather than a real job, and rollout work such as writing methods and training that nobody budgeted for. Gartner predicted at least 30% of generative AI projects would be abandoned after proof of concept.

How long should an AI pilot run?

Long enough to compare against a baseline on the same measure: typically about eight weeks of real use after four weeks of baseline for a weekly job. Set the decision date before starting, so the pilot ends in a choice to expand, adjust or stop.

How do you scale an AI pilot?

Write down the method so others can follow it, put the knowledge it relies on into shared files, train users on their own tasks, set a clear approval point and assign an ongoing owner. Scaling is mostly moving the expert's context into the system, not copying the tool.

When should an AI pilot be stopped?

Stop it when it misses its agreed measure after a fair trial, when checking its output costs more than it saves, when nobody will own the rollout, or when the job turns out not to matter. Record the decision and what was learned for the next pilot.

Sources
  1. Gartner. "Gartner Predicts 30% of Generative AI Projects Will Be Abandoned After Proof of Concept by End of 2025." Reported by Intelligent CIO, 5 August 2024. https://www.intelligentcio.com/apac/2024/08/05/gartner-predicts-30-of-generative-ai-projects-will-be-abandoned-after-proof-of-concept-by-end-of-2025/
  2. MIT NANDA. "The GenAI Divide." Reported by THE Journal, 28 August 2025. https://thejournal.com/articles/2025/08/28/report-most-organizations-see-no-business-return-on-gen-ai-investments.aspx
  3. Kaput, Mike. "MIT study on AI pilots." Marketing AI Institute, 26 August 2025. https://www.marketingaiinstitute.com/blog/mit-study-ai-pilots
  4. McKinsey. "The state of AI in 2025: Agents, innovation, and transformation." McKinsey, November 2025. https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai

Talk to us

Find out where AI pays in your business.

Thirty minutes, with the person who would do the work. You leave with the two or three places we would start, whether or not we work together.