In an effort to secure a future rooted in AI, many enterprises are inadvertently rewinding back to the past. Before cloud transformation and SaaS eclipsed on-premise software and infrastructure, company data was often siloed by default because interconnectivity between departmental functions was either too cumbersome, or impossible.
Once cloud tools became dominant, however, point solutions by necessity morphed into point solutions imposed by vendor lock-in and inflexibility by design. In the pursuit of fast utility, many businesses set themselves up to incur increased costs down the road, with few options to roll back the tech sprawl that had become so ingrained.
For all of the infinite potential agentic AI has to offer, the current rush to deploy intelligent agents risks the very same information silos that created a generation of technical debt and enterprise-wide fragmentation.
This warning comes from Manoj Mohan who joined us for an interview to discuss the risks of siloed agent sprawl in the enterprise. Mohan spent over two decades on the front lines of automation as Head of Engineering for Data Platforms and Insights at Intuit, and previously Meta, Apple, and Cloudera.
Mohan's solution is a proactive architectural approach centered around an Enterprise Architecture team that is given enough latitude to define a blueprint the entire company sticks to. The three-layer solve prevents agent chaos by first cataloging all agents in a shared registry for visibility, then standardizing their communication through a common protocol, and finally controlling their actions with automated governance-as-code. But the architectural blueprint cannot exist in hypothetical isolation; it requires reusable technical foundations for agents to interoperate.
"It's like the early days of the cloud. You feel incredible velocity at first, but after a year or two, your costs have exploded and it's too late to easily fix the architecture. The same problem is now set for a ripple effect, and the risk in integrating disparate systems later comes with a steep price."
Inevitably, internal pre-planning eventually needs to meet customers where they are.
Despite a clear path forward, Mohan offered a sober prediction. Most companies, he believes, will get it wrong first. "AI transformation is happening at such a rapid pace that even hardcore technologists are finding it hard to keep up. If engineering leaders can't keep up, how can we anticipate that larger enterprises will get this right on the first iteration?"
The pressure is immense, especially as prominent leaders like Salesforce’s Marc Benioff make bold claims about massive AI-driven productivity gains and human worker replacement. Mohan predicts many companies will try to "put some numbers out there to buy time" as they learn. "My hunch is that most non-tier-one enterprises will only solve for agent sprawl in a second or third iteration, after some problems have already started to percolate."
It should be clear by now that AI for the sake of AI is not a viable strategy, but the obvious is not always obvious when complex externalities pressure businesses to act less than rationally. "The pragmatic answer, unfortunately, is many leaders are still trying to find how to prove AI as a core part of their strategy. But AI is not just part of your strategy. If you bring that lens, you're never going to get the best value. It has to be holistic," Mohan said. Proactively planning the chain of ownership, managing stakeholder communication, and getting the fundamentals of orchestration right from the outset is a recipe for minimal risk and maximum probability of success.