PrymeIntelligence

Training teams for AI agents·Playbook

How to run calibration sessions for wealth advisers

How to run calibration sessions for wealth advisers: review the same drafted suitability reports and held client requests alone, then agree standards.

Wealth advisers calibrate on suitability. Give every adviser the same eight to ten client files where the agent drafted a recommendation or held a request, ask each to decide alone whether it is suitable and why, then compare. Discuss the splits, record a gold standard with the evidence that decided it, and update the agent's brief.

What makes calibration different for wealth advisers?

Advisers own their client relationships, and many have built their practice over years. Suitability is personal judgement anchored in the client's objectives, capacity for loss and attitude to risk. Two advisers reading the same fact-find can reach different portfolios and both defend them. That is acceptable within limits. Calibration finds the limits.

An advice agent typically prepares review packs, drafts suitability reports and rebalancing proposals for an adviser to approve and send, answers routine client questions, and flags signs of vulnerability or changed circumstances. Recommendations stay at depth 2: the adviser signs and sends. The agent holds anything it cannot ground in the client file, including client instructions that arrive only by email.

The head of advice owns calibration. The compliance or file-checking lead should attend, because their sampling findings are the best source of cases. The agent's owner attends so agreed standards reach the brief.

How do you run it?

  1. Agent, depth 1: assembles candidate files: drafted reports, held instructions, vulnerability flags, with the bound that applied and the adviser's final action.
  2. Facilitator: picks eight to ten. Include a client asking for more risk than their profile shows, an older client with possible vulnerability, a rebalancing triggered by market movement, and one held instruction. Remove adviser and client names.
  3. Each adviser: reviews alone: suitable as drafted, suitable with changes, or not suitable, with a reason tied to the fact-find.
  4. Agent, depth 1: tabulates the spread.
  5. Group: discusses the widest splits, focusing on which fact-find evidence each adviser relied on.
  6. Head of advice, with compliance: confirms the gold standard.
  7. Agent owner and builder: update the brief, add cases to certification and re-certify.
Step The agent does Depth Stays with a person
Assemble Lists drafts and held items 1 Facilitator selects
Review alone Nothing none Each adviser
Spread Tabulates 1 Nothing
Discuss Nothing none Group
Gold standard Nothing none Head of advice, compliance
Update agent Replays cases 1 Agent owner, builder

Which files should be in the pack?

Risk mismatch. A client with a cautious profile asks for a concentrated position in one sector. The agent drafts a report explaining why it is unsuitable and holds the trade. Advisers differ on whether an insistent client's informed request can proceed. Agree the standard and the documentation it needs.

Vulnerability. An older client's emails show confusion about past meetings. The agent flags it. Advisers must agree what follows: a call, involving a trusted contact the client has named, pausing recommendations. The gold standard should be explicit that vulnerability handling comes before any recommendation.

Rebalancing after a market fall. The agent drafts a rebalance back to target. Some advisers would wait and talk to the client first. Calibrate when a drafted rebalance goes to the client and when a conversation comes first.

Instructions by email. A message, apparently from the client, asks to move funds to a new account. That is external information and cannot authorise a payment. The agent holds it. Advisers must agree the call-back and verification standard, without exception.

Cost and charges. A switch that improves the portfolio but adds charges. Agree how the report must show the trade-off.

Write every gold standard so a new adviser could apply it without asking. "Use judgement on vulnerable clients" is not a standard. "Where the agent flags possible vulnerability, the adviser calls the client before any recommendation is sent, and records the call" is.

Which controls leave evidence?

  • Independent reviews before discussion. Evidence: timestamps.
  • Reasons tied to the fact-find. Evidence: each review cites the section relied on.
  • Compliance present for gold standards. Evidence: their name on each entry.
  • Vulnerability handled before calibration use. Evidence: the response in the client record precedes the calibration entry.
  • Re-certification after brief changes. Evidence: the certification run.

What should you measure?

  • Agreement on shared files, over successive sessions.
  • File-check findings on calibrated issues.
  • Drafted reports sent unchanged, by recommendation type.
  • Time from vulnerability flag to adviser contact.

Where does calibration go wrong for advisers?

"My clients are different." Sometimes true, often a defence. Separate genuine client difference, which the fact-find shows, from adviser preference, which it does not.

Investment views dominate. The session drifts into market opinion. Bring it back to suitability evidence.

Compliance is absent. Without the file-checking lead, gold standards can conflict with what checking will accept.

The agent's drafts stay unchanged. If the agent keeps drafting the old view, advisers keep rewriting it. The agent owner must attend.

Other adviser roles face similar personal-judgement problems; calibration sessions for HR advisers are a useful contrast, and calibration sessions for underwriters show how a regulated pricing team does it. Where calibration sits in the first months is laid out in the AI agent training plan template for wealth advisers, and the wider programme in training teams for AI agents.

Where the Academy fits

Pryme Intelligence Academy's Operator track teaches advisers how a governed agent decides, why it holds, and how to review its drafts. Module tests are set in the learner's own industry and role, so an adviser is tested on advice cases. A business can choose to make an adviser's approval rights over agent drafts depend on a current Certified Pryme Operator certificate, which is valid for 12 months.

Questions people ask

Should paraplanners join adviser calibration?

Yes, for the report-drafting cases. Paraplanners often prepare what the agent now drafts, and they spot gaps in reasoning quickly. Keep the suitability decision with advisers.

Does calibration limit adviser independence?

It limits unexplained variation, not judgement. An adviser can still depart from a gold standard when the client's facts justify it, provided the file records why.

How often should advisers calibrate?

Monthly for the first quarter, then quarterly, plus a session whenever the agent's bounds change or file checks show drift.

Train the people who run your agents.

Pryme Intelligence Academy: free courses on the real product, audio lessons, labs in a free workspace, and certificates anyone can check on VerifyDoc.ai. Teams get seats, an admin view and a free readiness assessment.