Every company we talk to has at least one. A prototype that impressed people in a meeting, got a green light, and then quietly stopped moving. Ask why and you'll hear something vague: the data wasn't ready, security had concerns, priorities shifted.
Those are symptoms. Underneath, the same four things are missing almost every time.
1. Nobody defined "works"
A demo works if the audience nods. A production system works if it hits a measurable bar on a representative set of inputs, including the ugly ones. If there's no evaluation suite, there's no way to know whether the last change made things better or worse, and no way to tell leadership the system is ready. Build the eval before you build more features.
2. The integration was hand-waved
The prototype reads from a CSV someone exported. Production has to read from the system of record, respect its access rules, and handle the fact that the data changes. That's real engineering, and it's usually more work than the AI part. Scope it honestly and early.
3. Security wasn't in the room
The first time the security team hears about the project shouldn't be the review that blocks it. Bring them in at the design stage, give them a real say in what the system is allowed to touch, and you'll find they're usually eager to help. Treat the AI system like a new employee: what does it need access to, how is that granted, how is it audited, how is it revoked?
4. Nobody owns it
Pilots are built by whoever was excited. Production systems need a team whose job it is to keep them running, with on-call, a budget for inference costs, and the authority to change things. If that team doesn't exist, the pilot will stay a pilot no matter how good it is.
A stalled pilot isn't a technology failure. It's a missing eval, a hand-waved integration, an absent security team, or an empty owner field. Usually more than one.
The good news is that all four are fixable, and none of them require a better model. They require someone to decide the boring parts are the job.
