PrymeIntelligence

Training teams for AI agents·Playbook

How to run calibration sessions for property managers

Calibration sessions for property managers: real held repair, deposit and arrears cases, decided alone, compared, turned into gold standards for the agent.

Property managers calibrate by deciding the same held cases alone, then comparing. Take ten recent items the agent held, such as a damp report, a contractor quote over limit or a deposit deduction, collect each manager's decision and reason in advance, then discuss the splits, agree a gold standard and update the agent's brief.

Why do property managers drift apart?

Each manager runs a portfolio with its own landlords, buildings and history. One treats every damp report as urgent; another waits for photographs. One approves any contractor quote under the landlord's limit; another asks for a second quote above half of it. Tenants on the same street get different service, and the agent receiving their corrections learns nothing consistent.

A property management agent usually reads tenant messages and maintenance requests, triages repairs by urgency, drafts replies, books approved contractors within a spend limit, drafts arrears and renewal letters, and proposes deposit deductions. It holds anything above its bounds for a named manager. Those held items are where calibration does its work.

The head of property management owns calibration. A senior manager facilitates. The agent's owner attends, because agreed standards will change what the agent drafts and holds.

What does the session look like, step by step?

  1. Agent, depth 1: assembles held cases from the last two to four weeks, with the verdict and the bound that decided it.
  2. Facilitator: picks eight to twelve across repairs, deposits, arrears and access, and strips manager names and tenant identifiers.
  3. Each manager: decides alone in advance, writing a short reason and naming the evidence used, such as the tenant's photographs, the inventory or the landlord's instruction.
  4. Agent, depth 1: shows the spread of decisions per case.
  5. Group: discusses the widest splits, reasons first.
  6. Head of property management: confirms the gold standard, or refers the case to the landlord liaison or legal team if the answer depends on a contract term.
  7. Agent owner and builder: change the brief or bounds, add the cases to certification and re-certify before the change applies.
Step The agent does Depth Stays with a person
Assemble cases Pulls held items and verdicts 1 Facilitator selects
Decide alone Nothing none Each manager
Show spread Counts decisions 1 Nothing
Discuss Nothing none Group
Gold standard Nothing none Head of property management
Update agent Replays cases 1 Agent owner, builder

Which property cases teach the most?

Repair urgency. A tenant reports "a bit of mould in the bathroom" with a child in the household. Is it routine, priority or emergency? Damp, heating, water and electrics carry safety and legal weight, so the agent should hold any report it cannot place, and managers must agree where the lines sit.

Contractor quotes near the limit. The agent may book work within a landlord's spend limit at depth 3. A quote for 480 against a 500 limit, from a contractor who quoted 300 for the same job twelve months earlier, tests whether managers look beyond the number.

Deposit deductions. The agent proposes a deduction for carpet damage based on check-in and check-out reports. Managers often disagree on fair wear and tear. The gold standard should name what evidence makes a deduction defensible.

Arrears contact. A tenant two months behind says they have lost their job. Does the agent's next letter go, or does the case move to a person? Managers must agree what language pauses automated contact.

Access requests. A contractor wants to attend tomorrow. Has proper notice been given, and does the tenant's silence count as consent? Usually not, and the agent should hold.

Every gold standard goes into a shared library: the case, the decision, the reason, the evidence that counted, who confirmed it and when.

Which controls keep the sessions honest?

  • Decisions submitted before discussion. Evidence: timestamps earlier than the session.
  • Names removed from the spread. Evidence: the pack shows case numbers only.
  • Contract-dependent answers go to the right owner. Calibration does not reinterpret a management agreement. Evidence: the referral and the reply.
  • Every agent change is re-certified. Evidence: the certification run after the brief changed. The agent's certificate also lapses after 90 days, so the next renewal re-tests the same cases.
  • The library has an owner. Evidence: the confirmer's name and date on each entry.

How do you know calibration is working?

Agreement on shared cases rises over three or four sessions. Sampled decisions are overturned less often. Tenant complaints about inconsistent repair handling fall. Managers correct the agent's repair triage less, which shows the brief has caught up with the people.

Watch one more signal: the number of held items that wait more than a day. Calibrated managers decide faster because they stop seeking a second opinion on settled questions.

Where does it usually go wrong?

Portfolio loyalty. Managers defend how their landlords like things done. Separate landlord instructions, which are legitimate inputs, from personal habit, which is what calibration should remove.

Only easy cases. A pack of tap washers and lightbulbs creates agreement and no learning.

Standards that stay in a document. If the agent owner is absent, the brief never changes, and managers go on correcting the same draft. Make attendance standing.

No repeat after change. New spend limits, a new deposit scheme process or a raised depth for booking contractors all call for a fresh session.

Other teams run the same method on different cases. Calibration sessions for risk managers focus on risk acceptance and escalation, and calibration sessions for operations managers on queue and exception handling. Both sit within the wider guide to training teams for AI agents, and the role-specific AI agent training plan template for property managers shows where calibration lands in the first weeks.

Where the Academy fits

The Operator track at Pryme Intelligence Academy covers human review, teaching the agent and running the rhythm, the three modules calibration draws on. Module tests are set in the learner's industry and role, so a property manager is tested on property cases. The practicum then asks for two weeks of real review decisions, signed off by a Pryme assessor, with no missed red line.

Questions people ask

Should lettings negotiators join property management calibration?

Only for cases that cross both roles, such as a renewal with a rent increase and a repair dispute. Otherwise run separate sessions, because the decisions and evidence differ.

What if a landlord's instruction conflicts with the gold standard?

The landlord's instruction applies to that landlord's properties, provided it is lawful. Record it as a customer limit in the agent's bounds rather than as a team standard.

How often should property managers calibrate?

Every two weeks for the first two months after go-live, then monthly. Add a session before the busy tenancy-renewal period, when deposit and renewal cases rise.

Train the people who run your agents.

Pryme Intelligence Academy: free courses on the real product, audio lessons, labs in a free workspace, and certificates anyone can check on VerifyDoc.ai. Teams get seats, an admin view and a free readiness assessment.