Many, and they are not settled. Common ones include agent reviewer, human-in-the-loop specialist, AI operations analyst, AI quality reviewer, agent owner and AI governance analyst. Plenty of adverts use an old title, such as claims handler or operations analyst, with agent supervision added to the duties. Search by duties as well as titles.
Which titles are in use, and what do they usually mean?
| Title you may see | Duties you would expect |
|---|---|
| Agent reviewer, AI reviewer, case reviewer | Deciding items an agent holds; sampling its work |
| Human-in-the-loop specialist, decision analyst | Approving held actions in real time; taking over conversations |
| AI quality reviewer, quality analyst (AI) | Scoring samples against a standard; calibration |
| AI operations analyst, automation operations analyst, digital operations analyst | Watching patterns across decisions; incidents; weekly review |
| Agent owner, AI product owner (operations) | Answering for one agent's scope, limits, changes and incidents |
| AI agent trainer, agent builder | Changing an agent's brief, sources and tests; certification |
| AI deployment specialist, implementation specialist (AI) | Taking agents from design to live use |
| AI governance analyst, AI risk analyst, AI assurance analyst | Controls, evidence, expiry tracking, audit support |
| AI operations manager | Running the team and rhythm across several agents |
Treat the table as a guide, not a rule. One employer's "AI operations analyst" decides held items all day; another's never touches the queue.
Why do existing titles hide so many of these roles?
Because many employers add agent work to jobs that already exist. A claims handler becomes the named reviewer for the claims agent. A finance operations analyst samples the payables agent. A team leader runs the review rhythm. The job title stays the same; the duties change.
Rules can push the same way. The EU AI Act's Article 4 asks organisations using AI to ensure a sufficient level of AI literacy among their staff, which leads some employers to describe AI duties inside ordinary roles rather than create new ones. The piece on what Article 4 AI literacy means for employees explains this. In card payments, adverts may mention PCI DSS duties for anyone supervising agents that touch card data; see PCI DSS v4.0 security awareness for people who supervise AI agents.
How should you search?
Search by duties as well as titles. Useful phrases in adverts include:
- Review and approval: "review AI-generated", "approve agent actions", "human review", "exceptions queue".
- Quality: "sample", "quality assurance of automated decisions", "calibration".
- Escalation: "escalation", "handover from automated channels", "complex cases".
- Oversight and records: "audit trail", "decision log", "oversight of AI tools".
- Improvement: "feedback to improve AI", "automation performance", "model or agent monitoring".
Take a job seeker we will call Clara, a payments operations analyst. Searching "AI reviewer" finds her a handful of adverts. Searching "exceptions" plus "automated" plus "payments" finds several times more, including two where the role is plainly supervising an agent under a traditional title. She applies to those, using the advert's own words to describe her experience of deciding held payments.
Do titles differ by country and industry?
Yes. Some markets favour "officer" and "associate"; others prefer "analyst" and "specialist". Regulated sectors such as banking and insurance tend to use risk and control language. Industries adopting agents at different speeds also shape what you see. For two markets, see which industries in New Zealand are hiring people to supervise AI agents and the equivalent for Saudi Arabia.
The underlying point is made in job titles have not caught up with AI agents, so read the duties. The guide to AI agent jobs and careers maps the roles behind the titles.
Questions people ask
Which title should I put on my CV?
Your real title, with the duties written clearly underneath. If you supervised an agent under an old title, say so in the first line of the role description.
Are "AI trainer" adverts about supervising agents?
Usually not. Many "AI trainer" roles are about rating and writing examples for model developers. Read the duties to check.
Will titles standardise?
Probably over time, as employers settle on job families for this work. Until then, duties are the reliable signal.