Why 89% of AI Investments Fail to Deliver ROI

Imagine pouring trillions of dollars into technology that promises to revolutionize your business, only to find yourself among the 89% of companies that see no customer value from these investments. This isn’t a hypothetical scenario, it’s the current reality of artificial intelligence adoption across industries worldwide.

The Trillion-Dollar Disconnect

The scale of investment in AI is staggering. Goldman Sachs predicts approximately $1 trillion in AI-related capital expenditures in the coming years, while Gartner projects AI software spending to reach nearly $298 billion by 2027, more than doubling from $124 billion in 2022. Organizations are planning to increase their AI investments by an average of 32% by 2026, according to Red Hat’s research.

Yet despite these massive financial commitments, the return on investment remains elusive for most:

89% of organizations are not yet driving customer value from their AI initiatives
Only about 5% of US companies are actually using AI in production processes
75% of executives aren’t seeing ROI from AI yet
Only 26% of companies have developed the necessary capabilities to move beyond proofs of concept

This paradox raises the question: why is there such a significant gap between investment and value realization in AI?

The Value Blockers: Why Most AI Investments Fail

The research points to several critical factors that prevent organizations from realizing value from their AI investments:

Strategic Misalignment

Many organizations pursue “shiny” AI technologies without identifying specific business problems to solve. They lack coherent digital strategies and fail to align AI initiatives with core business objectives. This misalignment often results in scattered, unfocused implementations that never translate to tangible business outcomes.

Data Foundation Challenges

Up to 85% of AI projects fail due to data-related issues. Fragmented ecosystems, legacy infrastructure, and poor data quality cripple AI effectiveness. As the saying goes in AI circles: garbage in, garbage out. Without clean, structured, accessible data, even the most sophisticated AI models will struggle to deliver value.

The Hidden “AI Tax”

Data preparation, platform upgrades, and ongoing maintenance can consume 60-80% of project budgets, creating a significant “AI tax” that many organizations fail to account for in their planning. These hidden costs often derail projects before they can demonstrate value.

Human and Cultural Barriers

The research consistently highlights that people-related challenges are the most significant barriers to AI success:

Skills gaps between technical expertise and business acumen
Workforce resistance due to fear of job displacement
Leadership hesitation in defining clear ROI metrics
83% of organizations report unauthorized “shadow AI” use by employees

Organizational Silos

Data science teams often lack authority to implement necessary workflow changes, creating frustrating bureaucratic barriers. Multiple layers of approval and misaligned incentives between teams further complicate implementation efforts.

The 26% Club: What AI Success Stories Reveal

The 26% of companies that are successfully generating value from AI, what Boston Consulting Group calls “AI leaders,” share several common characteristics:

Superior Performance

These AI leaders have achieved impressive results over the past three years:

1.5 times higher revenue growth
1.6 times greater shareholder returns
1.4 times higher returns on invested capital
Better performance in non-financial areas like patents filed and employee satisfaction

Business-First Mindset

Successful organizations focus on business frictions and customer value rather than getting caught up in technical details. They prioritize solving specific business problems rather than adopting AI for its own sake.

Focused Deployment Strategy

Instead of pursuing numerous use cases with minimal resources, successful companies pursue fewer opportunities but go deeper, investing for longer periods with dedicated business staff driving implementation. They expect twice the ROI compared to their peers.

Core Process Prioritization

AI leaders generate 62% of value from core business processes, giving them a competitive advantage. They target their fundamental business operations where value potential is highest:

Operations (23%)
Sales and marketing (20%)
R&D (13%)
Support functions (38%), including customer service, IT, and procurement

Organizational Alignment

Successful organizations create cross-functional teams with clear authority to change workflows and incentives. They establish regular forums to discuss implementation, with visibility to leadership, breaking down the silos that typically hinder AI adoption.

The 70-20-10 Principle: The Secret to AI Success

Perhaps the most important finding from the research is the 70-20-10 principle. This rule states that:

70% of AI success depends on people and processes
20% depends on technology and data
10% comes down to algorithms

This distribution is often inverted in organizations struggling with AI adoption. They mistakenly prioritize technical issues over human ones, focusing on algorithms and infrastructure while neglecting the critical people and process components.

The most critical capabilities for scaling AI are largely people and process-related, including change management, product development, workflow optimization, AI talent, and governance. This explains why even organizations with advanced technical capabilities often fail to realize value from their investments.

Bridging the Gap: The Path Forward

As market patience for experimentation wanes, organizations must shift toward accountability and measurable outcomes to ensure their AI investments finally deliver on their transformative promise. This requires:

Building robust, clean data foundations
Cultivating workforce collaboration with AI systems
Addressing technology, people, and security in equal measure
Quick adoption of generative AI alongside predictive AI
End-to-end workflow redesign with aligned incentives

As Amanda Luther, BCG partner and report coauthor, concludes: “When companies undertake digital or AI transformations, they need to focus two-thirds of their effort and resources on people-related capabilities, and the other third or so split between technology and algorithms.”

The message is clear: successful AI adoption isn’t primarily a technical challenge, it’s a human one. Organizations that recognize this fundamental truth will be well-positioned to join the elite group generating real value from their AI investments.

What’s Your Experience?

Is your organization among the 89% still struggling to realize value from AI investments, or have you found ways to overcome these challenges? We’d love to hear about your experiences with AI implementation and what strategies have worked for you. Share your thoughts in the comments section below!

Footnotes: