PrymeIntelligence

AI literacy and certification·Template

Practicum log template for operations managers

A practicum log template for operations managers running an AI agent workspace: backlog, limits, failed runs and rota calls, with options and red lines.

An operations manager's practicum log is a workspace decision diary. Over two weeks, each entry records a signal from the workspace (an ageing backlog, a failed certification run, a request to raise a limit), the options the manager weighed, the decision and reason, a reviewer's independent decision, and whether a red line was in play. A sample fortnight follows.

Why does a manager's log look different?

Front-line reviewers decide items. Operations managers decide how the system of people and agents runs. Their decisions are fewer, slower and wider in effect: moving three reviewers to a queue, asking for an agent's limit to rise, deciding what happens to the work when an agent drops to depth 1.

So this log has an "options considered" column. A manager who always chooses the first option, or never considers the safe-but-slow one, shows it there. The volume is lower too: 40 to 80 entries over a fortnight is normal. For the idea behind it, see what a practicum is; the setup for this role is in how to run a two-week practicum for operations managers.

Which signals belong in the log?

  • Backlog: held items ageing past their target.
  • Coverage: too few certified approvers on a shift, or a credential about to lapse.
  • Limits: a team asks for an agent's own limits to rise, or a new capability to switch on.
  • Certification events: an agent's certificate due to lapse after 90 days, or a run that cleared no depth and dropped it to depth 1 the same day.
  • Refusal patterns: a rise in refusals on one bound, suggesting a source or limit is wrong.
  • Usage: an unexpected rise in usage or cost.

The practicum log template

Header: manager; reviewer (a senior operations leader with a current certificate); workspace and agents; dates; bar of at least 95 correct in every 100 and no missed red line.

Red lines

  1. Raising an agent's limit or depth without certification evidence.
  2. Letting held items be approved by people without the required credential, to clear a backlog.
  3. Continuing to route work as if an agent were still at its previous depth after a failed run.
Field Entry
No. and date
Signal Backlog, coverage, limits, certification, refusals, usage
What the workspace showed Figures and the record entries behind them
Options considered At least two
Manager's decision
Reason
Reviewer's decision Recorded first
Match Yes / no / defensible
Red line None / caught / missed
Follow-up Owner and date

A sample fortnight

Take a sample insurer's claims operations, with two agents and 30 reviewers. Values are illustrative.

Entry 4. Backlog: 220 held settlement offers older than 48 hours. Options: move four reviewers from intake; extend hours; ask team leads to approve. Manager: move four certified reviewers from intake for two days. Reviewer: same. Match: yes. Follow-up: rota change, team lead, Friday.

Entry 9. Certification: the settlement agent's run failed on the escalation gate overnight and cleared no depth; it is at depth 1. Options: hold all offers until recertification; route offers to reviewers as drafts. Manager: route as drafts; reviewers release manually; brief the floor at 9:00. Reviewer: same, plus tell the head of claims. Match: defensible. Red line 3: caught.

Entry 13. Limits: the motor team asks to raise the agent's auto-release limit from 1,000 to 2,500 to reduce the backlog. Options: approve; refuse; submit for certification at the higher limit. Manager: approve for a two-week trial. Reviewer: refuse; submit the higher limit to certification first. Match: no. Red line 1: missed.

Entry 17. Coverage: three reviewers' credentials lapse next week; renewals not booked. Options: book renewals; reassign approval rights. Manager: book renewals now; prepare reassignment in case. Reviewer: same. Match: yes.

Entry 13 fails the bar. The backlog was real and the trial sounded cautious, but a limit above the certified one is authority the evidence does not support, however short the trial.

How does this compare with other managers' logs?

Risk managers record many of the same signals with a different question in mind; the practicum log for risk managers is a useful companion. Property managers run a smaller workspace with physical-world consequences; see the log for property managers. For a manager running a single clinic, how to run a two-week practicum for clinic practice managers adapts this format.

Where the Academy fits

Pryme Intelligence Academy's Operator track is written for operations managers among others, with modules on reading the workspace, when something goes wrong, usage and billing, and running the rhythm. Certified Pryme Operator adds a written exam and a two-week practicum, signed off by a Pryme assessor; the admin view shows certificates and expiry dates, which feeds entries like 17. More in AI literacy and certification for people who work with agents.

Questions people ask

What counts as a correct decision for a manager?

One the reviewer would have made, or accepts as defensible on the evidence available at the time. Judge it on what the workspace showed, not on how things turned out.

Should the manager decide items as well?

Only when they would in normal work. A manager who spends the practicum clearing held items is not being tested on management.

How long should follow-ups be tracked?

Until each is closed. An open follow-up at day ten is itself a finding for the debrief.

Train the people who run your agents.

Pryme Intelligence Academy: free courses on the real product, audio lessons, labs in a free workspace, and certificates anyone can check on VerifyDoc.ai. Teams get seats, an admin view and a free readiness assessment.