EvaluatorDescriptor
junjo.evaluation.EvaluatorDescriptor
Kind: Class
SDK version: 0.69.0
Documentation channel: Stable release
Signature
Section titled “Signature”EvaluatorDescriptor(key: str, version: int, role: EvaluationRole, expectation_schema: Mapping[str, object])Inspectable evaluator identity, role, and expectation JSON schema.
Members
Section titled “Members”key: strStable evaluator key used by dataset cases.
version
Section titled “version”version: intVersion of the registered evaluator contract.
role: EvaluationRoleJudge or verifier role for this evaluator and its telemetry.
expectation_schema
Section titled “expectation_schema”expectation_schema: Mapping[str, object]JSON Schema for authoring the evaluator criteria stored with each case.