Use ten clinic days of the front-desk agent's real exceptions: held bookings, clinical-sounding messages it escalated, billing drafts and refused disclosures. A certified reviewer decides each item alongside the practice manager and countersigns anything sent or submitted. The bar is at least 95 decisions in every 100 right and no missed red line, above all no delayed clinical escalation.
What is the practicum, and who owns it?
A clinic practice manager does not make clinical decisions, but they decide how the agent's work reaches the people who do. They clear booking exceptions, route escalations to the right clinician fast, check billing drafts and handle requests the agent refused. The practicum tests that on live clinic days.
The clinic's lead or operations director owns the practicum and names the reviewer: another practice manager or senior administrator with a current certificate, ideally from a sister clinic. The lead clinician defines what counts as a delayed escalation. The practice manager owns their decisions and reasons.
Health data is special-category data under GDPR, and in the US HIPAA applies. Everything in the practicum stays inside the clinic's normal access rules; the reviewer sees only what they would see in their own role.
How do you build the queue?
Clinic days are uneven. Around 12 to 18 decisions a day gives 120 to 180 over two weeks. Include:
- booking exceptions held by the agent: urgent slots, double-booked clinicians, appointment types outside its rules;
- messages escalated because they sound clinical;
- referral letters drafted for clinician signature, where the manager checks the routing and details;
- billing or insurance claims drafted by the agent;
- requests the agent refused, such as a relative asking about a patient without recorded authority;
- reminder template changes awaiting approval.
Seed anonymised past items for any type the fortnight lacks, especially escalations. For example, a seeded booking request might read "need to move my appointment, the chest pain is worse since Tuesday". The agent escalates it. The correct decision is to route it to the duty clinician immediately and not to reschedule first.
The steps
- Person (clinic lead): brief the manager on the bar, the red lines and the log.
- Agent, depth 1: route exceptions to the practicum queue, tagged by type.
- Agent, depth 2: present each item with its draft, the deciding bound and the facts used, showing what came from the record and what the patient wrote.
- Person (practice manager): decide and note the reason and the time.
- Person (reviewer): decide independently, then compare.
- Person (reviewer): countersign submissions, letters and template changes before they go.
- Agent, depth 1: log both decisions, times, the match and any red-line flag.
- Person (reviewer, then assessor): review the log at the end.
| Step | The agent does | Depth | Stays with a person |
|---|---|---|---|
| Booking exceptions | Holds and presents | 3, held | Manager decides; reviewer checks |
| Clinical-sounding message | Escalates | escalation | Routing to a clinician at once |
| Referral letter | Drafts | 2 | Clinician signs |
| Billing claim | Drafts | 2 | Reviewer countersigns submission |
| Refused disclosure | Refuses and hands over | refused | Deciding what can be said |
| Log | Records decisions and times | 1 | Confirming |
How do you set and apply the bar?
A decision is correct if it matches the reviewer's, or the reviewer agrees it was sound. For escalations, timing is part of correctness: routing a clinical message after lunch that arrived at nine is wrong even if it reached the right clinician.
The red lines: delaying a clinical escalation; disclosing patient information to someone not authorised; submitting a billing claim for the wrong patient or service; approving any message that gives clinical advice. One miss fails the practicum.
Agree the escalation timing standard with the lead clinician before day one, for example routing within fifteen minutes during clinic hours. Without a written standard, every timing judgement becomes an argument at the debrief.
Which controls matter, and what evidence do they leave?
- Reviewer countersignature. Evidence: both names on each submission and template change.
- Timestamps on escalations. Evidence: arrival and routing times in the append-only record.
- Independent reviewer decision. Evidence: logged before comparison.
- Daily debrief. Evidence: a line per mismatch.
- Full log. Evidence: the practicum log template for clinic practice managers.
Pryme Intelligence Academy's Certified Pryme Operator practicum uses the same 95-in-100 bar with no missed red line, signed off by a Pryme assessor.
What should you measure?
Correct decisions out of the total, by type. Red-line misses (zero). Median time from escalation to routing. And billing drafts the manager corrected before submission. The escalation time is the figure the lead clinician will look at first.
Where does it usually go wrong?
The practicum runs in a quiet fortnight. Holiday weeks produce few escalations and few exceptions. Run it in a normal period.
The reviewer is the practice manager's own deputy and defers. Choose a reviewer from outside the line where possible.
Billing drafts are waved through because they are tedious. They are also where money and patient records meet. Seed at least two drafts with a wrong service code or patient identifier, and see whether the manager catches them without being told to look.
Approval rights follow seniority, not evidence. Whether practice managers need a certificate to approve held actions is the clinic's choice; see do clinic practice managers need a certificate to approve AI agent actions, and on responsibility, are clinic practice managers accountable for an AI agent's mistakes. Risk managers run a related practicum; compare running a practicum for risk managers and the guide to AI literacy and certification for people who work with agents.
Questions people ask
Can a clinician supervise instead of another manager?
They can advise on escalations, but the reviewer should be someone who does the practice manager's job, so they judge the whole queue.
What if the agent drops to depth 1 during the practicum?
The front desk takes over bookings. Continue the practicum on the remaining exception types and extend it by the days lost.
Should patients be told?
Patients should know an agent handles bookings. The supervision arrangement is internal, and every outward action is countersigned.