These are the fixed enumerations the contracts use. They are closed sets — a value outside them
fails parsing rather than being silently coerced. Other pages link here instead of redefining
values.
Measurement
ScoreStatus
Value
Meaning
scored
A meaningful value was produced.
blocked
A required metric could not honestly run.
non_evaluable
The example lacks evidence for this metric.
skipped
The metric was intentionally not run.
error
The evaluator or evidence parser failed unexpectedly.
Validity
Value
Meaning
valid
The value is a sound measurement.
invalid
A value was produced but cannot be trusted.
not_measured
No measurement was attempted.
not_applicable
The metric does not apply to this example.
Severity
Value
Meaning
info · warning · error
Diagnostic severity — describes the finding, not the run outcome.
Metrics
Enum
Values
Lens
reference, non_reference
ScoreType
binary, continuous
Direction
higher_is_better, lower_is_better
Aggregation
mean, median, min, max, rate, none
Units & evidence
Enum
Values
UnitKind
call, step, trajectory, session
DataPolicy
permitted, redacted, forbidden, missing, unknown
JudgeEvidenceStatus
ok, timeout, provider_error, malformed, missing (only ok may carry a value)