If 2024 was the year of the AI pilot and 2025 was the year of integration, 2026 is shaping up to be the year the invoice arrives.
As enterprises move from experimental sandboxes to full-scale commercial deployment, a new, uncomfortable reality is setting in for customer experience leaders: "intelligence" is expensive.
While the promise of AI-driven personalization and automated support is starting to deliver, the underlying costs of the hardware and software infrastructure required to power it are becoming harder to ignore. For tech buyers, that raises questions about the sustainability of AI applications in customer-facing settings.
As the costs of compute and inference skyrocket, the ripple effects are poised to disrupt pricing models, vendor stability and the pace of adoption.
Is Your CX Strategy Ready for the Real Cost of AI?
The appetite for AI in the enterprise is voracious. Recent industry statistics suggest that upwards of 80% of Fortune 500 companies have committed to integrating GenAI into their workflows by the end of 2026.
More than 95 percent of enterprises plan to use GenAI APIs or models, and/or deploy GenAI-enabled applications in production environments by 2028, according to Gartner research. And as enterprises move beyond chatbots and deploy agentic AI, 82 percent of executives plan to adopt agents to handle tasks within the next 1-3 years, according to a report by the World Economic Forum in collaboration with Capgemini.
In the customer experience space, leaders are banking on large language models (LLMs) to drive contact center efficiency, transform marketing efforts and deliver personalized, end-to-end customer journeys at scale.
But the growing cost of AI services could threaten the widespread adoption of those applications. As James Mackay, Regional Sales Manager at conversational AI firm Rasa, told CX Today, while enterprises have capitalized on free and low-cost subscriptions “the ultimate cost of AI” could come home to roost.
While OpenAI reported last week that its annual recurring revenue (ARR) jumped to $20BN last year from $6BN in 2024, it will need to bring in well over $100BN to break even.
The company’s plan to start testing ads, which CEO Sam Altman had previously said would be a last resort, suggests it is under pressure to diversify its revenue to cover high infrastructure costs.
Mackay pointed out the risk to CX operations of vendors potentially hiking prices to close their profitability gaps:
“The cost is still far cheaper than it actually is to deliver… Hopefully they're not working towards getting people on the platform and then charging loads of money, because that will stop AI actually progressing."
The Inference Iceberg
The primary culprit is inference costs. In the early days of the AI boom, the focus was on the cost of training models. That requires a massive, one-time capital expenditure to teach an LLM how to think. But for customer-facing applications, which can run around the clock interacting with millions of customers, the real cost is inference: the computational power consumed each time a model generates a response.
"Training, that's a one-time billed cost, but where we're moving is to inference, which is the ongoing operating cost of actually running AI in the real world... Training creates capability, inference determines profitability," Lo Toney, Founding Managing Partner at Plexo Capital, told CNBC recently.
"Inference economics are going to be important to watch for 2026."
Unlike traditional software, where the marginal cost of serving a user is negligible, every interaction with an LLM burns electricity and processing cycles. As customer experience use cases scale from hundreds of beta testers to millions of active customers, these inference costs can compound, creating unpredictable operating expenses that many enterprises haven't budgeted for.
The stress on the system is clear at the top of the food chain. The major players providing the infrastructure, including Google, Amazon, Meta, Microsoft, are scrambling to fund the capacity required to keep the lights on. Wall Street consensus estimates for 2026 capex have been repeatedly revised higher, climbing to $527BN at the end of 2025.