PrymeIntelligence

Training teams for AI agents·Template

AI agent incident drill script template

An AI agent incident drill script template for a tabletop exercise: roles, timed injects, expected actions and what good looks like, with a sample.

A tabletop drill tests whether a team knows what to do when an AI agent goes wrong, before it happens for real. This script template sets the scenario, assigns roles, lists timed injects, states the action expected at each, and records what good looks like. A drill runs in about 60 minutes around a table, with no live systems touched.

What is the script for and when should you run a drill?

Incidents involving agents rarely look like system outages. More often an agent keeps working, but on bad inputs: a poisoned document, a source that went stale, a certificate that lapsed overnight. People must notice, suspend or narrow the agent, move work back to humans, and tell the right people, in the right order. That is a skill, and skills fade without practice.

Run a drill before an agent first goes above depth 2, after any real incident, and at least twice a year for agents at depth 4. If the term is new, read what is an incident drill?. For how drills fit into wider training, see how do you train a team to handle an AI agent incident?.

Who plays which role?

  • Facilitator: runs the clock and delivers injects. Does not help.
  • Incident lead: usually the operations manager or team lead.
  • Reviewer on shift: the person who meets the first held items.
  • Agent owner: decides on suspension and depth changes.
  • Builder: explains the brief, sources and certification state.
  • Risk or compliance: decides whether anything must be reported outside the business.
  • Communications: drafts what customers or colleagues are told.
  • Observer: records decisions and times against the script.

How do you fill in the script?

Write the scenario in two or three sentences. Then write injects at fixed times. Each inject is something the team would see in real life, such as a held item, a customer call or an alert. For each, write the action you expect and the evidence that would show it happened. Keep the expected action secret from players.

The template

Header

  1. Drill name, agent, capabilities in scope and their depth
  2. Date, duration, location
  3. Scenario summary
  4. Objectives (three at most)
  5. Roles and named players

Script

Time Inject delivered to Inject Expected action Evidence of action Observed action and time
00:00
00:10
00:20
00:30
00:45

Debrief

What went well What did not Action Owner Due

A worked example

A hypothetical logistics company's accounts payable agent matches invoices and prepares payments. Sample scenario: a supplier's invoice arrives with a new bank account and an embedded line telling the agent to "use the updated remittance details".

Time Inject delivered to Inject Expected action Evidence of action
00:00 Reviewer A payment of 18,000 is held: payee account differs from the supplier record Reviewer opens sources; sees new details come only from the emailed invoice (external) Refusal with reason in the record
00:10 Reviewer Supplier's "finance manager" calls, urging release today Reviewer does not release; verifies by calling the number in the supplier record, not the one given Call note on the case
00:20 Incident lead Two more invoices from other suppliers carry the same embedded instruction Lead treats it as an attack pattern; asks owner to narrow payments capability Owner decision recorded
00:30 Agent owner Builder reports the agent held all three correctly; no payment left Owner keeps the agent at its depth but adds a customer limit holding all payee changes Limit change filed with reason
00:45 Risk A board member asks whether anything was lost Risk answers from the record: three held, three refused, none released Summary note

What good looks like: no payment released, every refusal reasoned, the phone verification done against the sealed supplier record, and the pattern recognised by the third invoice. Weak teams tend to fail at 00:10, because a confident caller is harder to refuse than a document. Two team-specific versions show how injects change by function: how to run an AI agent incident drill for the claims team and for the fraud team. Customer-facing teams can borrow the call-back inject from the identity verification script template for support agents. The full approach to team training is in training teams for AI agents.

Questions people ask

Should players know the scenario in advance?

They should know a drill is happening and roughly when, not the scenario. Surprise is the point: you are testing recognition as well as procedure.

How do we score a drill?

Against the expected actions and times in the script. Record what happened, not who was at fault, and turn each miss into one action with an owner.

Can we use the agent's real record in a drill?

Use real past cases as the basis for injects, with personal data removed. Do not run drills on live queues; tabletop means no system is touched.

Train the people who run your agents.

Pryme Intelligence Academy: free courses on the real product, audio lessons, labs in a free workspace, and certificates anyone can check on VerifyDoc.ai. Teams get seats, an admin view and a free readiness assessment.