Governments need guardrails for autonomous AI systems

The Urban Institute warns that state and local governments deploying self-acting AI must establish governance structures before these systems become embedded in public services.

By ·

Sep 21, 2026

6 cards · 1m 30s · tap to begin

From · · · 1m 30s

Governments need guardrails for autonomous AI systems

The Urban Institute warns that state and local governments deploying self-acting AI must establish governance structures before these systems become embedded in public services.

In brief

The Urban Institute warns that state and local governments deploying self-acting AI must establish governance structures before these systems become embedded in public services. Governments should document AI agents' purpose, target population, and outcomes before deployment, with oversight levels matching how…

Governments test autonomous AI systems

State and local governments are experimenting with agentic AI that can independently plan and take action toward goals, unlike conventional generative AI that only produces content.

Virginia finds $1.4 billion in savings

Virginia's pilot used agentic AI to review regulatory documents for redundant language, identifying over $1.4 billion in annual savings and cutting permit processing times by nearly 80%.

Utah and Boston deploy their own pilots

Utah and Boston deploy their own pilots

Utah tested autonomous AI for prescription renewals with 91% physician agreement on recommendations. Boston integrated agentic AI into its open-data portal to analyze municipal data and inform policy.

Non-IT staff can now build AI agents

Unlike traditional AI, agentic systems can be created by employees outside IT departments, accelerating innovation but also creating risks for errors and workflow disruptions in sensitive functions.

“What's different about the agentic generative AI is that the IT person is not the only person who is empowered to build it.”

Document purpose before deploying agents

The Urban Institute recommends agencies document an agent's intended purpose, target population, measurable outcomes and estimated costs before deployment, with accuracy and fairness defined separately.

Oversight should match the stakes

Internal systems can operate at smaller scales with less stringent controls, but constituent-facing systems like disability benefits require greater scrutiny and fairness metrics tailored to specific populations.

In short

Governments should document AI agents' purpose, target population, and outcomes before deployment, with oversight levels matching how sensitive the application is.

Read the original on Pymnts

React

Sign in to react and comment.

Comments (0)

Life is short. Keep it sweet. Respect others' opinions and be kind!

    Recommended next

    More decks on agentic ai and related topics.