Why AI Struggles To Break The Cycle Of Legacy

IT modernization – While agentic AI shows potential for mapping complex technical debt, experts warn that the economics of AI-driven modernization remain a volatile gamble for CIOs.
For decades. the promise of IT modernization has hung just over the horizon. a recurring five-year goal that never seems to arrive. Technology leaders have cycled through web services, microservices, cloud migrations, and virtualization, yet the finish line keeps receding. Now. agentic AI has arrived as the latest potential elixir for this chronic industry condition. but skeptics are questioning whether it is a solution or merely another expensive distraction.
A recent survey of 2. 000 senior IT decision-makers reveals a sharp disconnect between the hype and the reality of the server room. Despite the industry buzz, only 10% of tech chiefs are currently deploying agentic AI to tackle their aging infrastructure. For the rest, modernization remains a grueling, often failing, project. Data from Kyndryl highlights the struggle: less than half of organizations report actual improvements in operations or innovation. while 18% see little to no value at all. Nearly half of all respondents admit they are falling behind schedule and bleeding money through cost overruns.
Modernization has historically focused on the exhausting task of swapping out mainframes for sleeker platforms. but the industry is shifting its gaze toward agentic AI. These autonomous systems are being tested to handle the granular. error-prone work of mapping hidden dependencies. generating code. and drafting documentation. Because fewer than one in ten organizations possess full visibility into how their old and new systems intertwine. this technical blind spot has long crippled transition efforts. Those who adopt these agents early are finding they are significantly less likely to fall behind on their project timelines.
The core of the problem is a persistent, structural addiction. Andy Thurai. founder of The Field CTO and a former chief strategist at IBM. characterizes modern IT as a chronic condition where businesses reflexively buy new software without ever successfully decommissioning the legacy systems underneath. Instead of solving the mess, AI is often used to layer over it. Thurai notes that vendors are aggressively pitching AI as a cure-all. yet the underlying economics frequently collapse under the weight of infrastructure sprawl. With 30% of leaders already dreading unpredictable compute costs. the monthly bill for AI-driven modernization risks becoming a black box that few can afford to manage.
Even as some organizations move beyond simple chatbots to use agentic frameworks as an orchestration layer, the cycle remains inevitable. Today’s cutting-edge AI architectures are simply the legacy environments of the future. waiting for the next generation of engineers to modernize them. For now. the challenge for CIOs is not just adopting the latest tool. but deciding whether AI can actually untangle the technical debt of the past or if it is just another way to fund the same endless quest.
AI IT modernization legacy systems agentic AI CIO technical debt Kyndryl