Confidence you can spend

A decision model is only useful if its confidence means something. This page uses the committed calibrated predictions of the Qwen3-1.7B head-trained model: drag the threshold to see how many decisions it can take alone, and how accurate those are.

Auto-decide vs escalate

confidence ≥ 0.90

Reliability diagram

observed accuracy per confidence bin perfect calibration bin size

Risk–coverage curve

accuracy of auto-decided questions coverage

By source

source	questions	accuracy	mean confidence