Skip to content

EvaluatorDescriptor

junjo.evaluation.EvaluatorDescriptor

Kind: Class

SDK version: 0.69.0

Documentation channel: Stable release

EvaluatorDescriptor(key: str, version: int, role: EvaluationRole, expectation_schema: Mapping[str, object])

View source

Inspectable evaluator identity, role, and expectation JSON schema.

key: str

View source

Stable evaluator key used by dataset cases.

version: int

View source

Version of the registered evaluator contract.

role: EvaluationRole

View source

Judge or verifier role for this evaluator and its telemetry.

expectation_schema: Mapping[str, object]

View source

JSON Schema for authoring the evaluator criteria stored with each case.