What is a time-boxed exam?

A time-boxed exam is a test that must be completed within a fixed period, then closes and is scored. For people who oversee AI agents, the time limit is not a formality: it checks that they can apply what they know at a working pace, the way decisions arrive on a live review queue.

Why does a time box matter?

Untimed tests reward looking things up. Given unlimited time, most people can find the answer to "may an emailed invoice authorise a payment?" in the course material. On a live queue, a reviewer has seconds, not an afternoon, and the held payment does not wait while they search. A time box tests whether the knowledge is available when needed.

It also makes results comparable and harder to game. With a fixed window, everyone faces the same pressure, and there is less chance to consult a colleague or a shared answer sheet.

How is the time box set?

The limit should come from the work, not habit:

1. Start from the role: how long does a competent reviewer take on a typical decision?
2. Count the questions: a scenario question needs more time than a definition.
3. Trial it: give the exam to experienced staff and note how long they take.
4. Add a margin: competent people should finish with time to check, not race to the end.
5. Hold it steady: once set, keep the limit the same for every sitting.

The plan for how many questions come from each topic sits in an exam blueprint, and the time box is set against it. For what the questions themselves should cover, see what an AI agent exam should test.

An example

A bank designs an internal exam for reviewers of an agent that drafts account changes. It has 30 questions: 20 short concept questions and 10 scenarios with a held action to judge. Trialled on five experienced reviewers, the exam takes them 25 to 35 minutes. The bank sets the time box at 45 minutes. A candidate who runs out of time with six scenarios unanswered has shown something useful: they know the concepts but cannot yet apply them at pace. The guide on designing an internal AI agent exam covers the full method.

How is a time-boxed exam different from time to competence?

The names are close, but they measure different things. A time-boxed exam limits how long a person has to answer one test. Time to competence is how long it takes a person, from starting, to reach the standard the role needs, which may be weeks. One is minutes on a test; the other is the length of the learning.

A time-boxed exam also differs from a practicum, which checks performance on real work over days or weeks. The two are complementary: the exam checks knowledge under time pressure; the practicum checks sustained performance.

Which terms are related?

• Exam blueprint: the plan the time box is set against.
• Pass mark: the score needed within the time.
• Proctored exam: supervised sitting, often with a time box.

Senior leaders often ask for shorter formats; training senior leaders without wasting their time covers how. For the full approach, read training teams for AI agents.

Where the Academy fits

The written exam for Certified Pryme Operator is time-boxed: 40 questions in 60 minutes, with 32 correct needed to pass. It sits alongside a two-week practicum, so the time-limited test of knowledge is matched by a test of sustained, real review work.