the voice of customer experience technology
Front page
InterviewCX Trust1h · 15:01 BST · 6 min read

Shadow AI Puts Customer Data and CX at Risk as Agents Raise the Stakes

Shadow AI agents are entering enterprise workflows with access to sensitive customer data and business systems, often without security oversight. As autonomous tools take action, CX leaders must help establish the governance, visibility and controls needed to protect customer trust.

An employee connects an AI agent to the company customer relationship management (CRM) platform to save time. The agent can now access customer records and interact with other business systems, but the security team may have no idea the agent exists or what it might do with that access.

This is the risk of unapproved tools and autonomous agents operating inside enterprise environments, known as shadow AI, potentially exposing sensitive customer data or taking actions without adequate oversight.

Recent research indicates the threat is already producing operational consequences. In an October 13 report, Salt Security found that 49.8 percent of more than 380 security and technology professionals had confirmed or suspected that an AI agent in their organization took an action during the previous 12 months that was unintended, unexpected or unauthorized.

Among those reporting such incidents, more than half cited an unauthorized external API call or transaction, while more than 40 percent reported an agent modifying or deleting data. The research also found that only 12.5 percent of respondents could consistently trace an agent's complete activity from its initial instruction through connected tools and APIs to the outcome.

A September survey from EY found a similar gap between AI adoption and oversight. Although 98 percent of senior AI executives said that their organizations had formal AI governance policies, 26 percent of those using agentic AI admitted they could not detect unauthorized agents operating internally. Meanwhile, 36 percent reported an AI incident or failure that had caused material harm, including data loss, financial damage, operational disruption or reputational damage.

The implications increasingly reach beyond IT security and into the scope of customer experience leaders. An unmanaged agent with access to CRM records, payment information or customer conversations could expose personal data, change account details or initiate actions that customers never authorized.

Why Shadow AI Is Harder to Detect Than Shadow IT

Speaking to CX Today during Cybersecurity Awareness Month, Ankita Gupta, Co-Founder and CEO of Akto, an agentic AI security platform for enterprise security teams, described shadow AI as one of the most pressing challenges facing enterprise security teams.

“Shadow AI is the number one cyber AI risk today and it is extremely difficult to track for multiple reasons.”

Shadow AI is harder to track than the shadow IT that happens when employees use software, services and devices without formal approval.

Employees can access AI through a range of possible entry points, making it difficult for security teams to maintain a reliable inventory of what is running across the business.

As Gupta explained, “they are using AI tools in browsers, they are using AI tools in the cloud, they are using SaaS agents in something like a Microsoft Copilot or Salesforce Agent Post. They're using desktop agents; they're using IDEs which have AI features.”

Traditional IT discovery processes can miss AI capabilities embedded within existing software or introduced through an employee's personal workflow.

“Shadow IT in twenty years hasn't changed a lot,” Gupta said. “But now in the last two years, the way AI is changing so quickly and moving so fast, that speed is very hard to match for cyber teams as well.”

For large enterprises, the challenge multiplies across departments and employee populations. A single organization might have thousands of people experimenting with different AI applications, each with its own integrations, access requirements and potential weaknesses.

When An AI Agent Can Act on Customer Data

The security implications become more serious when employees move from using AI to generate content or answer questions to deploying agents that can perform tasks.

 “Agents change the game a lot,” Gupta said. “They are autonomous in nature, they have access to lots of sensitive data.”

This could mean an agent accessing customer conversation histories, exposing personal information, changing account records or triggering an action that should have required additional authorization. Gupta said:

“It becomes extremely difficult and extremely important to guardrail that data access to make sure agents have all kinds of policies, controls, guardrails in place. Especially if it is customer data, especially if it is employee data, especially if you're dealing with enterprise information.”

The financial services sector illustrates the potential consequences. An agent connected to banking systems could encounter payment information or other sensitive customer records. If its permissions are too broad, or it follows an inappropriate instruction, the consequences could extend beyond a data exposure incident.

“Imagine an agent going rogue which is able to take that payment information and is able to take an action on behalf of the user without the user actually giving that permission for making a payment,” Gupta said. “That's a financial loss and very big reputational loss, brand loss for the company as well.”

Gupta argued that businesses need to support adoption while establishing appropriate controls.

“It's a competitive advantage to use AI right today… [L]ong term everyone is going to use AI, so they might as well just adopt good policies, governance, all of that.”

CX leaders need to understand which tools employees need to do their jobs and identify how they can use those tools safely. An AI assistant that drafts internal marketing copy presents different risks from an agent that can access customer payment records or alter account information.

Policies should reflect those differences, with permissions, approval requirements and human intervention proportionate to the potential impact.

The discovery process needs to extend beyond well-known public AI services. Organizations may already know that employees use ChatGPT or Claude, for example, but have less insight into locally run models, browser-based tools, embedded AI features or unauthorized integrations.

Why Shadow AI Governance Is Not Just a Security Team Responsibility

Security teams have a central role in identifying and managing shadow AI, but they cannot own every decision about how AI is used across the business.

Customer service leaders understand the workflows, customer information and service outcomes involved in their operations. Marketing, human resources, finance and development teams have their own data, applications and operational risks to consider.

Gupta recommends creating a central committee to coordinate AI risk management that brings together representatives from development, customer-facing teams, marketing, HR, finance and security to establish governance policies and coordinate decisions.

However, centralized oversight needs to be accompanied by responsibility within individual departments. It helps establish who is accountable when an AI system handles customer data or performs an action. Without clear ownership, teams may assume that another department has approved a tool or is monitoring its behavior.

As AI becomes more deeply integrated into service workflows, unmanaged tools and agents can create risks that extend from internal operations to customer trust. Even well-intentioned experimentation can create security and customer experience problems that are difficult to detect until damage has already been done.

rate this story
helps rank stories across CX Today
The discussion0 takes · attributed & checked

Does this reflect your experience?

opening the room…
Read nextordered by techtelligence · every pick explained
same beat · CX Trust

Amazon Connect Customer Targets the CX Problem Brands Still Miss

22 Oct 2026
same beat · CX TrustPHPocalypse Security Flaws Force Websites Offline to Protect Customers22 Oct 2026same beat · CX TrustGoogle Cloud Power Outage Disrupts U.K. Banks and Essential Services20 Oct 2026