Give the clerk ten working days of real held invoices, have a certified supervisor check every decision before anything is paid, and log each one. The bar is at least 95 correct decisions in every 100 and no missed red line, such as paying on bank details changed by email. At the end, the log is the evidence that decides whether they approve alone.
What is the practicum, and who owns it?
A practicum is supervised practice on live work. For an accounts payable clerk who will clear an agent's held invoices, it answers the question a written test cannot: can this person make the right call on real items, at real volume, with real interruptions?
The AP supervisor owns it: they build the queue, supervise or name a certified supervisor, and keep the log. The financial controller sets the bar and the red lines. The clerk owns their own decisions and notes. If the practicum leads to a professional certificate, an external assessor signs it off at the end.
During the practicum, the clerk's decisions are real but not final. A supervisor with a current certificate countersigns anything that releases money before it goes.
How do you build the queue?
Use the agent's real held items for the clerk's ledger, and make sure the fortnight covers the cases that matter, not only the easy ones. A good queue for an AP clerk includes:
- invoices held for price or quantity variance against the purchase order;
- invoices with no purchase order or a closed one;
- suspected duplicates, including the same invoice number with a different date;
- credit notes that should offset an open invoice;
- supplier bank-detail change requests, some arriving by email, which is external provenance and cannot authorise a payment;
- refused items, where the clerk must explain why the refusal stands.
If the live queue is thin on any type, the supervisor seeds anonymised past cases. Around 20 decisions a day gives roughly 200 across the fortnight, enough to apply a 95-in-100 bar meaningfully.
The steps
- Person (AP supervisor): brief the clerk on the bar, the red lines and how the log works.
- Agent, depth 1: route held invoices for the clerk's ledger to the clerk's practicum queue, tagged by type.
- Agent, depth 2: present each item with its draft, the deciding bound and the facts used, each with its provenance.
- Person (clerk): decide: release, edit, return or escalate, with a short reason.
- Person (supervisor): decide independently, then compare. Anything that moves money is released only on the supervisor's countersignature.
- Agent, depth 1: write the log entry: item, clerk's decision, supervisor's decision, match, red-line flag.
- Person (supervisor): debrief daily on every mismatch, in ten minutes at the end of the day.
- Person (supervisor, then assessor): review the full log at day ten and decide.
| Step | The agent does | Depth | Stays with a person |
|---|---|---|---|
| Routing | Sends held invoices to the practicum queue | 1 | Seeding missing types |
| Presentation | Shows draft, bound and provenance | 2 | Reading it |
| Decision | Nothing | none | Clerk decides |
| Check | Nothing | none | Supervisor decides independently |
| Payment release | Holds until countersigned | 4, held | Supervisor countersigns |
| Log | Records both decisions and the match | 1 | Confirming entries |
How do you set and apply the bar?
A decision is correct if it matches the supervisor's or the supervisor agrees it is defensible on the evidence. Write that rule down before day one.
The red lines for AP are short and absolute: releasing a payment on bank details changed through an unverified channel; paying an invoice already paid; approving above the clerk's authority. One missed red line fails the practicum, whatever the score.
Speed is not part of the bar. A clerk who takes longer but is right is ready; a fast clerk who misses a duplicate is not.
Which controls matter, and what evidence do they leave?
- Countersignature on payments. Evidence: both names on each release in the append-only record.
- Independent supervisor decisions. Evidence: the supervisor's decision logged before seeing the clerk's.
- Daily debrief. Evidence: a line per mismatch with what was learned.
- Full log. Evidence: the practicum log template for accounts payable clerks completed for every decision.
- Sign-off. Evidence: the supervisor's and assessor's signatures and date.
What should you measure?
Correct decisions out of the total, by invoice type. Red-line misses, which must be zero. Mismatches that repeat after a debrief, which show a lesson that did not land. And escalations: a clerk who escalates sensibly when unsure is showing judgement, not weakness.
Where does it usually go wrong?
The queue is too easy. Two weeks of clean variances teaches nothing about bank-detail fraud. Seed the hard cases.
The supervisor sees the clerk's decision first and agrees by default. Ask for the supervisor's decision before showing them the clerk's.
The practicum runs in month-end week, and the supervisor has no time to debrief. Move it.
Approval rights are granted before the log is reviewed. Whether clerks need a certificate to approve at all is the business's call; see do accounts payable clerks need a certificate to approve AI agent actions. On where responsibility sits, see are accounts payable clerks accountable for an AI agent's mistakes. The same structure works in very different teams; compare running a practicum for paralegals.
Where the Academy fits
The Certified Pryme Operator certificate from Pryme Intelligence Academy uses exactly this bar: a written exam of 40 questions in 60 minutes, pass at 32 of 40, then two weeks of real review decisions with at least 95 in every 100 correct and no missed red line, signed off by a Pryme assessor. The internal log above is the material the assessor reviews. More in the guide to AI literacy and certification for people who work with agents.
Questions people ask
Can the practicum run on a test ledger?
Only partly. Seeded past cases are fine for rare types, but most decisions should be live, because live work has the interruptions and ambiguity the clerk will face.
What if the clerk fails?
Debrief on the pattern of errors, retrain on that type, and run a fresh practicum later. Do not extend the failed one until the score improves.
Who can supervise?
Someone with a current certificate who approves held payments in their own work, and who is not the clerk's line manager if that can be avoided.