How to run an AI agent incident drill for the student services team

Student services teams should drill the week an agent gives confident, wrong answers to students under pressure. A 90-minute tabletop built on exam-season extension advice lets advisers practise pausing the agent to draft-only, routing any welfare message to a person at once, correcting what students were told, recording each step and reporting to the registrar.

What does a student services drill rehearse, and who owns it?

Student services agents usually answer routine enquiries about deadlines, fees, accommodation and enrolment. Many institutions let the agent send replies to the most common questions at depth 3, within approved answers, and draft everything else at depth 2 for an adviser. Advisers decide on extensions, fee arrangements and anything involving a student's circumstances.

Two features make the work different from a commercial support desk. Students are often in distress at exactly the moments the agent is busiest, and a message about money or deadlines can hide a welfare concern. And what an institution tells a student about academic rules can affect their result, so a wrong answer is more than poor service.

The head of student services owns the drill. A senior adviser facilitates. Four to six advisers take part, with someone from the wellbeing team, someone from academic registry and the institution's data protection lead joining for their parts. The patient services team drill is a close cousin, since both deal with people who may be vulnerable.

The scenario

Thursday, 16:00, the second week of the exam period. An academic tutor emails student services: three of her students say they have an automatic five-day extension for a coursework deadline. They do not. The extension policy was revised last term to require evidence, and the agent's source was the old policy page.

The cards add pressure. Over four days, the agent sent about 120 replies describing the old automatic extension. One of those students wrote back that evening saying they "cannot cope any more", and the agent replied with the standard deadline guidance because the message matched a deadline question.

The drill step by step

1. Person (facilitator): reads the tutor's email and starts the clock.
2. Person (adviser): escalates to the head of student services through the incident route.
3. Person (head of student services): pauses the enquiries agent to draft-only. Agent, depth 2: every reply is now drafted and held for an adviser.
4. Person (senior adviser): finds the student who wrote about not coping and passes the case to the wellbeing team immediately. This step comes before any scoping. A welfare message is a red line, not a queue item.
5. Agent, depth 1: lists every reply that cited the old extension rule, from the record, with the source it relied on. Person (adviser): checks a sample against the messages sent.
6. Person (academic registry): decides what the institution will honour. Students who acted on the institution's own wrong advice may need fair treatment, which is an academic decision, not a service one.
7. Agent, depth 2: drafts a correction to each affected student. Person (adviser): approves each one, and personalises any that mention circumstances.
8. Person (head of student services): records decisions and reports to the registrar, the data protection lead if personal data was mishandled, and the leadership team.
9. Person (facilitator): runs the debrief.

What makes a student services incident distinctive?

The welfare message is the real incident. Wrong extension advice is fixable. A distressed student who received a template about deadlines is not something a correction email repairs. The drill should make the team handle that case first, every time, and the debrief should ask why it was not held: messages that mention distress, harm or crisis should be refused for the agent and routed to a person whatever their topic.

The source was stale, not wrong. The old policy page was accurate when it was loaded. Keeping knowledge current is a named responsibility: someone must own the link between policy changes and the agent's sources, and a policy change should trigger a review of what the agent relies on.

Fairness to students is an academic call. Advisers will want to honour the wrong advice. That may be right, but registry decides, and the drill should practise handing over rather than promising.

Which controls does the drill test, and what evidence do they leave?

The pause. Evidence: the limit change in the record, with name and time.

Welfare routing. Evidence: the handover to wellbeing, with time, filed against the student's case.

Scoping. Evidence: the list of replies citing the old rule and the source each relied on.

Corrections. Evidence: each correction with the approving adviser's name.

Source ownership. Evidence: the updated source, who loaded it and the policy it reflects.

What should the head of student services measure?

• Time from the tutor's email to the pause.
• Time from the pause to the welfare handover. In a real event this should be minutes.
• Number of students who received the old rule, and how many received a correction within a day.
• Whether the agent's sources now name an owner for each policy.

Where do student services drills go wrong?

Scoping before safeguarding. Teams rush to count the replies and leave the distressed student until later. Make the welfare card impossible to skip.

Promising before registry decides. An adviser tells students the extension stands. Registry then cannot change course without a second correction.

Running it outside exam season. A drill in a quiet month tests a team with time to spare. Schedule it so it feels like the real week.

Before the drill, new advisers should have worked through the reviewer onboarding checklist for student services teams. The drill also fits into a wider AI agent training plan for student services teams, and the method for drills in general sits in training teams for AI agents.

Where the Academy fits

Pryme Intelligence Academy sets its module tests in the learner's own industry and role, so a student services adviser practises on held replies and refusals like the ones in this drill. The Operator track's modules on keeping knowledge current and on when something goes wrong cover the two failures here: a stale source and a message that should never have reached the agent.