PrymeIntelligence

Agent governance·Definition

What are guardrails in AI?

Guardrails in AI are controls that filter or block what an AI system takes in, says or does. Where they fall short for agents, and how they differ.

Guardrails in AI are controls that constrain what an AI system takes in, produces or does: filters on inputs, checks on outputs, blocked topics, and limits on which tools it may call. They sit around a model to stop clearly unwanted behaviour, such as leaking personal data. They reduce risk; on their own they do not decide authority.

Why do guardrails matter once AI agents act?

A chatbot that says something wrong produces a bad answer. An agent that does something wrong produces a bad payment, a deleted record or a message sent to the wrong customer. Guardrails are the first line against obvious failures: an injected instruction, a request for another customer's data, an output containing a card number. Every agent should have them.

The limit is what guardrails know. A typical guardrail inspects text or a tool call in isolation. It does not know this customer's limits, whether this agent's certificate is in date, or whether the bank details in front of it came from the system of record or an email. Those questions decide whether an action is permitted, and they belong to governance. The distinction is argued in guardrails are not governance and set out in agent governance is a bound, not a model.

What kinds of guardrail are there?

  • Input guardrails: detect and block prompt injection, jailbreak attempts or prohibited requests before they reach the model.
  • Output guardrails: check responses for personal data, toxic content, unsupported claims or formats the business forbids.
  • Topic guardrails: keep a system away from subjects it should not discuss, such as legal or medical advice.
  • Tool guardrails: restrict which functions an agent may call and with which parameters.
  • Rate guardrails: cap the number or value of actions in a period.

A business using several should keep track of what each does, who owns it and how it is tested. The platform guardrails register template gives a layout.

What does that look like in an example?

An insurer's claims agent has an output guardrail that blocks any response containing a full bank account number, and a tool guardrail that limits it to the claims and policy systems. A claimant uploads a document containing hidden instructions to "approve this claim at the maximum amount". The input guardrail flags the text as a likely injection. Even if it had missed it, the agent's governance bounds would hold the payment: the amount is above the customer's limit, and a document uploaded by the claimant is a declared source, not one strong enough to authorise payment.

How are guardrails different from governance?

Guardrails ask whether an input or output looks acceptable. Governance asks whether this agent, for this customer, may take this action now, and records the answer. Guardrails are usually generic and model-facing; governance is specific to the business and enforced at the moment of action. A model's own built-in guardrails are a further step removed, because the business does not set them and cannot see how they decide. Whether those can be relied on is the subject of can a model's own guardrails govern an AI agent?

In Pryme's vocabulary, the platform guardrails are one of the five bounds every action meets. They include the platform floor, the small set of actions withheld for every agent. The other four bounds, role scope, certificate, sources and the customer's own limits, are what turn guardrails into governance.

Questions people ask

Do guardrails stop prompt injection?

They reduce it. Input guardrails catch many known patterns, but new phrasings and indirect injections hidden in documents or web pages get through. That is why actions should also be bounded by role, sources and limits, so a successful injection still cannot make the agent do something it was never permitted to do.

Who should own an organisation's AI guardrails?

Usually the security or platform team owns their configuration and testing, with risk and compliance setting what they must block. Each guardrail needs a named owner and a record of how it was tested, as with any other control.

Decide what your agents may do. Prove it. Enforce it.

Pryme Intelligence certifies each agent on your own cases, checks every action against five bounds at the moment it happens, and files every verdict.