Assess the team behind the first lending decision an agent touches: usually origination or collections, not both. Staff take a test set in lending on depth, provenance of income evidence, held decisions and the reasons a decline must carry. The report shows gaps by concept and decides whether the first agent chases documents, drafts credit summaries or works arrears.
Why does a lender need this before go-live?
Lending decisions are among the most regulated uses of AI. Under the EU AI Act, creditworthiness assessment and credit scoring of natural persons are listed as high-risk. Under GDPR Article 22, people have rights around decisions based solely on automated processing with significant effects. In the US, ECOA and Regulation B require specific reasons when credit is denied, including when a model is used. This is an explanation of the rules, not legal advice; confirm how they apply to you with counsel.
All of that lands on the person reviewing what the agent held. The assessment checks whether that person understands the agent well enough to give a real review, not a signature. The head of lending operations owns it; credit risk and compliance see the results. For the concept, see what a readiness assessment is.
Who should take it?
One team of up to 25, matched to the first agent.
Origination: loan officers, credit analysts who decide referrals, and the team leader who holds the highest approval authority.
Collections: collections agents, the team leader, and someone from the vulnerable customers or hardship team.
Mixing origination and collections dilutes the result. The two teams meet different concepts: origination leans on provenance and decline reasons, collections on refusals, tone and when to stop.
The steps
- Person (head of lending operations): chooses the team and lists the decisions the agent will never make alone, such as declining an application or agreeing a write-off.
- Person (head of lending operations): asks for the test set in lending.
- Person (each member): sits the test alone.
- Person (head of lending operations with credit risk): read the report by concept.
- Person (head of lending operations): picks the first agent and its depth. A typical first agent drafts document requests and application summaries at depth 2.
- Person (team leader): trains the weakest concept using the lender's own products.
- Agent, depth 1: reads closed applications in shadow and proposes what it would have held, refused or passed to a credit analyst.
- Person (cohort): reassesses before live drafting.
| Step | The agent does | Depth | Stays with a person |
|---|---|---|---|
| Choose team | Nothing yet | None | Never-decide list |
| Sit the test | Nothing yet | None | Individual answers |
| Read the report | Nothing yet | None | Gaps, with credit risk |
| First agent | Named as candidate | None | Agent and depth |
| Train the gap | Runs in practice labs | Practice | Learning |
| Shadow | Proposes verdicts on closed files | 1 | Comparing with real decisions |
| Reassess | Nothing new | 1 then 2 | Go-live |
What does the test usually find in lenders?
Income evidence. Lenders see payslips, bank statements, data shared directly from the applicant's bank, and the applicant's own figures. In governed terms these sit in different provenance classes: an applicant's stated income is declared, an uploaded statement is external until verified, data received directly from a known source is signed. Staff often treat a clean PDF statement as if it were verified. The test exposes this quickly.
Decline reasons. Staff know a decline needs reasons. Fewer understand that if an agent drafted the assessment, the reasons must still be specific and true, and the reviewer must be able to state them from the record. The test checks whether people know where to find them.
Refusals in collections. Collections staff sometimes read a refused action, such as the agent declining to send a demand to a customer flagged as vulnerable, as a fault. It is the bound working.
What does the report change?
It narrows the first agent. A team weak on income provenance should not start with an agent that assesses affordability. Document chasing and application summaries, where a credit analyst still makes the call, are the safer start.
It changes approval rights. If the team leader with the highest authority scores lowest on the decision chain, that is the first person to train. Some lenders adopt a rule that approval rights at each depth depend on a current reviewer certificate.
It feeds the lender's governance. The report, the decision and the reassessment become part of the evidence of how staff were prepared for a high-risk use.
What should the lender keep as evidence?
The never-decide list, signed off by credit risk.
The report by concept.
The first-agent decision and reasons.
The reassessment before live work.
What should the head of lending operations measure?
- Scores by concept, especially provenance and the decision chain.
- During shadow, cases where the agent would have passed an application that a credit analyst referred, and the reverse.
- After go-live, decline letters whose reasons a reviewer could not trace to the record.
Where does it go wrong in lenders?
Starting with decisions. The business case targets faster approvals. The report says the team is ready for document chasing. Go with the report.
Skipping the hardship team. In collections, the people who handle vulnerable customers are the ones most likely to catch an agent's error, and the least likely to be invited.
Assessing brokers' staff last, or never. Where intermediaries submit applications the agent reads, their understanding of what counts as evidence matters too.
Banks and fintechs face overlapping questions; compare the bank version and the fintech version. The readiness assessment report template gives a format, and what a readiness assessment measures explains the scoring. The topic guide is training teams for AI agents.
Where the Academy fits
Pryme Intelligence Academy offers a free readiness assessment for teams of up to 25, using the Foundations test set in the team's own industry. Approvers can go on to the Operator track, whose practicum is two weeks of real review decisions signed off by a Pryme assessor, with no missed red line allowed.
Questions people ask
Can an agent decline a loan?
It can draft a decline with reasons for a person to approve. Whether any decline happens without a person depends on the rules that apply and the lender's own limits; most lenders keep it with a person.
Should credit risk staff take the test?
They should take it in their own sitting. Their questions are about oversight and model risk, not daily review.
When should a lender reassess?
Before each new product the agent works on, before any increase in depth, and after changes to lending policy.