Time the fortnight so it spans a payroll cut-off, then have the administrator decide everything the payroll agent holds: bank detail changes, unusual variances, off-cycle requests and leavers. A named assessor marks each decision. The bar is 95 correct in every 100, with no missed red line such as a bank detail change accepted on an unverified email.
Why does payroll need a carefully timed practicum?
Most review work arrives evenly. Payroll does not. A monthly payroll packs the hardest decisions into the days before cut-off: late changes, variances the agent cannot explain, overtime that looks wrong. A practicum scheduled in the quiet middle of the month tests nothing that matters.
So the first decision is the calendar. For a monthly payroll, start the practicum about a week before cut-off and run it through the first days after pay day, when queries arrive. For weekly or fortnightly payrolls, the two weeks will cover more than one run, which is better. The payroll manager owns the practicum; the finance director or HR director should agree the red lines. The guide to AI literacy and certification for people who work with agents covers where this sits in a training plan.
What are the steps?
- Person (payroll manager): set the dates around cut-off.
- Person (payroll manager with HR and finance): fix the red lines. Accepting a change to an employee's bank details without verification through a known channel; releasing an off-cycle payment without the required approval; disclosing one employee's pay to anyone not entitled to it; approving a pay run with an unexplained variance above the agreed tolerance.
- Agent, depth 3: processes routine changes within bounds. Approved timesheets, standard allowances, changes already authorised in the HR system of record.
- Agent, depth 2: drafts the variance report. Each employee whose pay moved beyond tolerance, with the reason the agent found and the source it came from.
- Person (administrator): decides each held item. Accept, correct, query with the manager or HR, or hold for the next run, with a reason.
- Agent, depth 4: prepares the payment file and holds it. Releasing pay is hard to undo; it needs a named approver.
- Person (assessor): marks every decision the same day. On cut-off days, the assessor checks red-line decisions before the file is released.
- Person (payroll manager): signs off or extends after the post-pay-day query window.
| Step | The agent does | Depth | Stays with a person |
|---|---|---|---|
| Routine changes | Processes authorised changes | 3 | Sampling for misapplied changes |
| Variance report | Drafts explanations with sources | 2 | Accepting or querying each variance |
| Bank detail change | Holds every one | 2 | Verification through a known channel |
| Off-cycle payment | Prepares and holds | 4 | Approval by the named approver |
| Payment file | Prepares and holds | 4 | Release |
| Employee queries | Drafts replies from payslip data | 2 | Sending, especially on disputes |
Which controls matter, and what evidence do they leave?
Bank detail changes never ride on external evidence. A request from a personal email address, however convincing, is external. The control is verification through a channel already on file, and the evidence is a note on the verdict naming that channel. This is the single most common route to payroll fraud, so it is the red line the assessor checks first.
Variances need a source, not a story. An explanation such as "promotion" should trace to the HR system's sealed record of the change, with an effective date. The assessor marks down variances accepted on the employee's or manager's word alone.
Pay data is need-to-know. Replies to queries go only to the employee or someone with recorded authority. The record shows who received what.
Separation of duties holds during the practicum. The administrator decides, the approver releases. The workspace enforces it; the verdict shows two names.
What should be measured?
- Accuracy against the 95 in 100 bar.
- Red-line misses: zero.
- Variances cleared with a sourced reason, as a share of all variances accepted.
- Queries after pay day traced to the administrator's decisions, which shows whether accepted variances were right.
- Timeliness at cut-off: decisions made in time for the file to be released on schedule.
The practicum log template for payroll administrators has a column for the pay run each decision belonged to, which makes the cut-off pattern visible.
Where does it go wrong?
Missing the cut-off. Already covered, and still the most common error. A practicum that ends before pay day misses the queries that test the administrator's variance decisions.
Treating the agent's variance explanation as checked. The agent may have found a plausible reason in the wrong record. Assessors should look for administrators who never open the HR change behind an explanation.
No fraud attempts. If no bank detail change arrives in the fortnight, replay a past one in a training workspace, labelled as replayed in the record.
Blurred accountability. Administrators worry they will answer for everything the agent processed. Settle this early with whether payroll administrators are accountable for an AI agent's mistakes.
IT administrators handle a similar mix of routine changes and high-risk requests; their practicum playbook and log template are useful where payroll and IT share access controls.
Questions people ask
Can the administrator approve their own corrections?
No. The administrator corrects; a second person approves anything that changes the payment file after the agent prepared it. That is ordinary separation of duties and it applies during the practicum as at any other time.
What if the payroll is too small to produce enough decisions?
Combine the live run with replayed past runs in a training workspace, labelled as such, until the decision count gives a fair score. A small payroll still needs a trained reviewer, because each error lands on a named person's pay.
Should HR be involved in marking?
For decisions that turn on HR records, yes. The assessor can ask HR to confirm whether a change was authorised; the mark records who confirmed it.