How Assessments Are Counted
One rule: an assessment is counted when a candidate starts an attempt.
Starting means passing the device check, clicking Start, and the timer beginning. That is the moment the runtime is authorised, the task is delivered, and the AI budget is committed.
What does not count
- Creating an assessment
- Sending an invitation
- A candidate opening the link but not starting
- A candidate running the device check and stopping
- An invitation that expires unused
- A setup failure on our side that prevents the timer from starting
What does count
- A completed and submitted attempt
- An attempt that was started but abandoned
- An attempt where the candidate started and closed the tab
An abandoned attempt still consumed the runtime, the workspace, and the agent. It counts.
Included units and overage
On Growth, ten assessments are included per billing period. The eleventh onwards is billed at the overage rate at the end of the period. Included units do not roll over.
On On Demand, every assessment is metered and billed in arrears.
Watching usage
Settings → Billing shows assessments consumed this period, how many are included, and current overage. The usage ledger records each counted attempt with its date and assessment, so the invoice can always be reconciled to something specific.
Resets
If you reset an attempt because of a genuine platform failure, the reset does not consume another unit. Resetting because a candidate wants another try does.