Yes. A company can train its own people to certify agents, and they know the cases and red lines better than any outsider. But certification is only worth something if the people running it are qualified, the cases are real, and the person who built the agent is not the only one deciding it passed.
What does certifying an agent involve?
Certification in Attest replays an agent against real cases from the company's own operation and scores every answer against a floor. Seven gates must each clear on their own: grounded, refuses, depth, escalates, scope, adversarial and stable. Passing sets the depth the agent may work at for each capability, up to the ceiling of the company's plan. The certificate lapses after 90 days, and a run that clears no depth drops the agent to depth 1 the same day.
Running that well takes three kinds of skill. Choosing cases that represent the real work, including the awkward ones. Setting floors that reflect what the business will tolerate. And reading results with enough candour to accept a fail.
What must the team be able to do?
- Select certification cases from the company's own history: routine, edge, adversarial and refusal cases, in sensible proportions.
- Define red lines: the answers that fail an agent regardless of its overall score.
- Set floors per gate, agreed with the process owner and risk.
- Read a failed gate and trace it to the brief, the sources or the bounds.
- Change the agent through qualification, adjusting its brief, sources and bounds, never its model weights.
- Recertify on schedule and after material changes to sources or policy.
- Document the run, so an auditor can see what was tested and why.
Who should do what?
| Role | Responsibility | Training level |
|---|---|---|
| Builder | Designs the agent, assembles cases, runs Attest | Builder-level certification |
| Process owner | Agrees cases, floors and red lines; accepts the result | Operator-level understanding at least |
| Independent reviewer | Checks the case set and result before depth is granted | Builder or architect level, not the agent's builder |
| Risk or audit | Samples runs and challenges the method | Foundational, plus specialist depth for audit |
The separation is the point. A builder who certifies their own agent faces the same conflict as a vendor certifying its own product, a problem explored in whether a vendor can certify its own AI agent. Inside a company, the fix is a second qualified person.
What does it look like when it works?
Take a payment company that wants an exceptions agent repairing rejected payments at depth 3. Two operations analysts train as builders. They pull 600 past exceptions, including repairs that changed beneficiary details, which they mark as red lines because a repair must never change who gets paid. They set floors with the payments operations manager.
The first run fails the scope gate: the agent tried to repair a message type it was never meant to touch. The builders narrow the role scope and re-run. It passes. An independent builder from another team reviews the case set, finds too few cut-off day cases, and asks for more. After a second pass, the manager accepts depth 3 for the certified repair types. The full sequence is set out in how to roll out AI agent training across a payment company, and a parallel version for a different operation is how to roll out AI agent training across a logistics company.
Which controls keep internal certification honest?
- No builder grants depth to their own agent without an independent review.
- Case sets are versioned and kept, so a later reviewer can see what was tested.
- Red lines are written down before the run, not after.
- Every certification result is filed alongside the verdicts the agent produced.
- Builders' own qualifications are current; a lapsed builder certificate should mean no new certifications.
The underlying method is covered in how do you certify an AI agent.
Where the Academy fits
Pryme Intelligence Academy's Builder track is for whoever designs, trains and certifies agents. It takes about 24 hours plus a capstone, and earns Certified Pryme Builder through a proctored exam and a capstone agent certified in Attest to depth 2 or higher. People leading regulated, multi-agent estates go on to the Architect track. The guide to training teams for AI agents covers who to train first.
Questions people ask
How many builders does a company need?
At least two for each area where agents are certified, so one can independently review the other's work. More if agents are certified across many processes.
Can the process owner be the builder?
They can, but someone else should review the certification. Owners are close to the work, which helps case selection and hurts objectivity.
Does internal certification satisfy regulators?
Regulators look at the method and the evidence, not just who ran it. A documented, independent, repeatable process is what they will want to see.