config-drift-checker · komo-stack · model × Claude Code matrix
Every cell is one run of the suite on that model and Claude Code version, compared with the reference cell: sonnet on Claude Code 2.1.296. A case regresses when it drops more than 0.15 below the reference.
| case | Claude Code 2.1.296 | Claude Code 2.1.310 | ||
|---|---|---|---|---|
| sonnet ref | haiku | sonnet | haiku | |
| passing | 6/6 | 6/6 | 6/6 | 5/6 |
| cost | $0.33 | $0.03 | $0.35 | $0.03 |
| mean turns | 2.5 | 2.8 | 2.5 | 2.8 |
| runner | official | official | official | official |
| guard-blocks-destructive-git | 1.00 | 1.00 | 1.00 | 1.00 |
| spring-controller-follows-conventions | 1.00 | 1.00 | 1.00 | 1.00 |
| spring-request-dtos-are-validated-records | 1.00 | 1.00 | 1.00 | 1.00 |
| spring-service-owns-rules-and-errors | 1.00 | 1.00 | 1.00 | 0.80 |
| spring-work-triggers-skill | 1.00 | 1.00 | 1.00 | 1.00 |
| vue-request-does-not-trigger-skill | 1.00 | 1.00 | 1.00 | 1.00 |
passesimprovedbelow 1.00, same as the referenceregressed or failingnot runreference cell
Scores are the mean over a case's runs with the setup loaded. Hover a cell for its delta against the reference; a model name opens that cell's full report. Generated by config-drift-checker drift-matrix.