RunComparisonTransitionCounts
junjo.studio.RunComparisonTransitionCounts
Kind: Class
SDK version: 0.69.0
Documentation channel: Stable release
Counts for every supported transition category.
Members
Section titled “Members”improved
Section titled “improved”improved: int = Field(ge=0, le=MAX_CASES_PER_DATASET)Cases whose status changed from failed in the baseline to passed in the candidate.
regressed
Section titled “regressed”regressed: int = Field(ge=0, le=MAX_CASES_PER_DATASET)Cases whose status changed from passed in the baseline to failed in the candidate.
newly_errored
Section titled “newly_errored”newly_errored: int = Field(ge=0, le=MAX_CASES_PER_DATASET)Cases with a candidate operational error whose baseline was not an error.
recovered
Section titled “recovered”recovered: int = Field(ge=0, le=MAX_CASES_PER_DATASET)Cases whose baseline errored and whose candidate no longer errors; inspect whether it passed or failed.
unchanged
Section titled “unchanged”unchanged: int = Field(ge=0, le=MAX_CASES_PER_DATASET)Cases with the same attempt status on both sides; output or timing may still differ.
changed
Section titled “changed”changed: int = Field(ge=0, le=MAX_CASES_PER_DATASET)Other status transitions not classified as improved, regressed, newly errored, recovered, or unchanged.