I’ve been wrestling with a question that keeps me up at night: Are we designing the right governance model for AI agents, or are we just projecting human organizational patterns onto fundamentally different entities?
Here’s what’s driving this question. 80% of Fortune 500 companies now use active AI agents in production. But only 21.9% of organizations treat these agents as independent, identity-bearing entities. The rest? They’re using shared API keys, treating agents like scripts rather than actors.
The Anthropomorphism Question
When we give AI agents RBAC permissions, resource quotas, and governance policies—treating them like user personas—we’re making a philosophical choice. We’re saying: “Agents are actors in our systems who need individual identities, role-based access, and resource limits, just like human users.”
But are they? Or are we anthropomorphizing what are ultimately deterministic (or probabilistic) tools?
The Shadow AI Crisis
The data suggests we’re not even having this conversation at the right level yet. 81% of teams are deploying AI agents without full security approval. We have a shadow AI crisis that mirrors the shadow IT crisis of the 2010s. Except this time, the “shadow users” are autonomous systems making decisions at machine speed.
88% of organizations have confirmed or suspected AI agent security incidents in 2026—unauthorized database access, data exfiltration attempts, privilege escalation. The threat model isn’t theoretical anymore.
The Identity Crisis
Here’s the practical tension. Auditors and regulators demand audit trails: “Who did what, when, and why?” For human users, this maps cleanly to identity systems. For agents, it gets murky fast.
Platform engineering teams in 2026 are treating agents as first-class citizens with:
- Individual identities: Each agent gets a unique identity, not a shared service account
- RBAC policies: Agents receive role-based permissions scoped to their purpose
- Resource quotas: Token budgets, inference limits, API rate limits
- Lifecycle management: Agents can be provisioned, suspended, and decommissioned
This looks exactly like user identity and access management. Except agents don’t log in. They don’t have passwords. They don’t forget their MFA tokens. They operate continuously, spawn sub-agents, and make decisions in reasoning loops we can’t fully observe.
Governance for Machines vs. Governance for Actors
I see two competing philosophies emerging:
Camp 1: “Agents are users”
- Agents need individual identities for accountability
- RBAC policies scope agent permissions just like human roles
- Audit trails require treating agents as distinct actors
- This leverages existing IAM infrastructure and mental models
Camp 2: “Agents need agent-native governance”
- Agents don’t need “roles”—they need capabilities, time-boxing, and declarative scopes
- Human-centric governance patterns don’t map to autonomous systems
- We need entirely new primitives: purpose-bound credentials, decision traceability, rollback mechanisms
- Forcing human patterns onto agents creates security gaps
The Stakes Are High
NIST launched the AI Agent Standards Initiative in February 2026 to address exactly this challenge: ensuring secure, interoperable agent systems. Singapore released a Model AI Governance Framework for Agentic AI. The industry is scrambling to define standards before regulation gets ahead of practice.
But standards don’t answer the philosophical question: Are we governing machines or governing actors?
If agents are machines—deterministic tools—then governance is about capabilities and constraints. Scope their access, limit their blast radius, monitor their outputs.
If agents are actors—autonomous decision-makers—then governance is about identity and accountability. Give them individual identities, role-based permissions, audit their decisions.
The answer probably isn’t binary. Different types of agents might need different governance models:
- A simple data transformation agent might just need capability-based access
- An agent that negotiates with customers or makes financial decisions might need full identity and audit trails
What I’m Seeing in Practice
We’re defaulting to the user-centric model because it’s familiar. We have mature IAM systems. Security teams understand RBAC. Compliance frameworks map cleanly.
But I suspect we’re missing something. Agents that spawn sub-agents break the identity model. Agents that reason through multi-step decisions expose gaps in audit trails. Agents that operate across organizational boundaries challenge our assumptions about trust.
The Question for This Community
Is treating AI agents like user personas the right governance model, or should we design entirely new paradigms?
And if we need new paradigms, what do they look like? How do we balance innovation velocity with security and compliance? How do we explain agent governance to boards, auditors, and customers who barely understand traditional IAM?
I don’t have the answers yet. But I know we can’t keep deploying agents with shared API keys and hoping for the best.
What are you seeing in your organizations? How are you approaching agent identity and governance?
Sources: