EvaluationExecutor
junjo.evaluation.EvaluationExecutor
Kind: Class
SDK version: 0.67.0
Documentation channel: Stable release
Signature
Section titled “Signature”EvaluationExecutor(*, client: EvaluationControlClient, harness: EvaluationHarness, source_revision: SourceRevision | None = None)Run application-owned evaluations inside one explicit host lifetime.
Enter the executor as an asynchronous context manager. It acquires the application’s runtime lazily before the first real target execution, reuses that runtime across generated cases and Runs, and closes it once on exit. Terminal or interrupted Attempts and local contract failures do not start application resources.
Members
Section titled “Members”run(*, dataset_id: str, request_key: str, run_label: str) -> RunDetailStart or idempotently resume one run at the clean current revision.
resume
Section titled “resume”resume(*, run_id: str) -> RunDetailResume one existing run only from its exact clean source revision.
generate_case
Section titled “generate_case”generate_case(request: GenerateCaseRequest) -> CaseReadExecute one target and retain evidence without blessing its output.