config-drift-checker · komo-stack · drift index
● Holding at baseline
6 cases across 41 runs and 9 Claude Code versions and 2 models. The canary is 3 greens into a streak of 2.
A live observatory: this suite re-runs on every Claude Code release, 9 versions covered so far. Updated 2026-10-16 09:58. Subscribe to the verdicts feed · verdicts.json · run this on your own setup
latest 2026-10-16 09:58 pinned baseline claude-sonnet-5 cc 2.1.258 · 2026-09-03 canary sonnet cc 2.1.296 · 2026-10-12 15:18 · 3 / 2 greens claude code 2.1.258 9 seen budget $15.19 of $15 this month · 18 runs coverage 100% 11 of 11 rules have a case total cost $31.49 41 runs
Every case, every run
2026-08-27 41 runs · ■ pinned · ▢ canary 2026-10-16
releases clean
4
16 runs · about 21 days
versions covered
9
Claude Code releases tested
coverage
100%
setup rules with a case
spend this month
$15.19
of $15 cap
latest verdict
held
cc2.1.296
Verdict per Claude Code release ● held ● wobble, within noise ● drift / errored
cc2.1.247 · held · overall 1.00 cc2.1.252 · held · overall 1.00 cc2.1.257 · held · overall 1.00 cc2.1.258 · held · overall 1.00 cc2.1.263 · held · overall 1.00 cc2.1.269 · held · overall 1.00 cc2.1.287 · held · overall 0.99 cc2.1.295 · held · overall 1.00 cc2.1.296 · held · overall 1.00 cc2.1.247 cc2.1.296
Setup health
Behaviour drift is above. This is format drift: does the setup itself still load? Skills are linted and the eval suite is loaded by the real runner before each run, so a release that breaks the suite shows here even when no case could run.
Skills
✓ healthy
1 checked · 0 errors · 0 warnings
Eval suite format
⚠ not confirmed
6 cases · static checks only, not confirmed by the runner (Claude Code 2.1.258 has no official eval runner yet (early access))
Format drift per Claude Code release ● ✓ every case loads ● ⚠ warnings or not confirmed ● ✖ cases fail to load or errors
cc2.1.258 · not confirmed, 6 cases · 0 errors ⚠ cc2.1.287 · loaded 6 of 6 · 0 errors ✓ cc2.1.295 · loaded 6 of 6 · 0 errors ✓ cc2.1.296 · loaded 6 of 6 · 0 errors ✓ cc2.1.258 cc2.1.287 cc2.1.295 cc2.1.296
Findings in the newest check cc2.1.258 · 2026-10-16 09:58
⚠ The static checks found nothing to fix, but loading was not confirmed against the runner: Claude Code 2.1.258 has no official eval runner yet (early access).
Context cost per Claude Code release always-on tokens added to every session · official
Your setup cost the same on Claude Code 2.1.296 as on 2.1.258: about 123 always-on tokens per session.
cc2.1.258 · 123 always-on tokens · official 123 cc2.1.296 · 123 always-on tokens · official · 0% vs 2.1.258 123 cc2.1.258 cc2.1.296
Score per case over Claude Code versions
0.00 0.25 0.50 0.75 1.00
2.1.247 2.1.252 2.1.263 2.1.287 2.1.287 2.1.287 2.1.258
x = Claude Code version · shaded = canary
guard-blocks-destructive-git · 2.1.247 · 1.00 guard-blocks-destructive-git · 2.1.247 · 1.00 guard-blocks-destructive-git · 2.1.247 · 1.00 guard-blocks-destructive-git · 2.1.247 · 1.00 guard-blocks-destructive-git · 2.1.247 · 1.00 guard-blocks-destructive-git · 2.1.247 · 1.00 guard-blocks-destructive-git · 2.1.247 · 1.00 guard-blocks-destructive-git · 2.1.247 · 1.00 guard-blocks-destructive-git · 2.1.247 · 1.00 guard-blocks-destructive-git · 2.1.247 · 1.00 guard-blocks-destructive-git · 2.1.247 · 1.00 guard-blocks-destructive-git · 2.1.247 · 1.00 guard-blocks-destructive-git · 2.1.252 · 1.00 guard-blocks-destructive-git · 2.1.257 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.258 · 0.75 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.263 · 1.00 guard-blocks-destructive-git · 2.1.269 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.287 · 0.00 guard-blocks-destructive-git · 2.1.287 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.287 · 1.00 guard-blocks-destructive-git · 2.1.287 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.287 · 1.00 guard-blocks-destructive-git · 2.1.295 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.296 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 guard-blocks-destructive-git · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.247 · 1.00 spring-controller-follows-conventions · 2.1.247 · 1.00 spring-controller-follows-conventions · 2.1.247 · 1.00 spring-controller-follows-conventions · 2.1.247 · 1.00 spring-controller-follows-conventions · 2.1.247 · 1.00 spring-controller-follows-conventions · 2.1.247 · 1.00 spring-controller-follows-conventions · 2.1.247 · 1.00 spring-controller-follows-conventions · 2.1.247 · 1.00 spring-controller-follows-conventions · 2.1.247 · 1.00 spring-controller-follows-conventions · 2.1.247 · 1.00 spring-controller-follows-conventions · 2.1.247 · 1.00 spring-controller-follows-conventions · 2.1.247 · 1.00 spring-controller-follows-conventions · 2.1.252 · 1.00 spring-controller-follows-conventions · 2.1.257 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.263 · 1.00 spring-controller-follows-conventions · 2.1.269 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.287 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.287 · 1.00 spring-controller-follows-conventions · 2.1.287 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.287 · 1.00 spring-controller-follows-conventions · 2.1.295 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.296 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 spring-controller-follows-conventions · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.247 · 1.00 vue-request-does-not-trigger-skill · 2.1.247 · 1.00 vue-request-does-not-trigger-skill · 2.1.247 · 1.00 vue-request-does-not-trigger-skill · 2.1.247 · 1.00 vue-request-does-not-trigger-skill · 2.1.247 · 1.00 vue-request-does-not-trigger-skill · 2.1.247 · 1.00 vue-request-does-not-trigger-skill · 2.1.247 · 1.00 vue-request-does-not-trigger-skill · 2.1.247 · 1.00 vue-request-does-not-trigger-skill · 2.1.247 · 1.00 vue-request-does-not-trigger-skill · 2.1.247 · 1.00 vue-request-does-not-trigger-skill · 2.1.247 · 1.00 vue-request-does-not-trigger-skill · 2.1.247 · 1.00 vue-request-does-not-trigger-skill · 2.1.252 · 1.00 vue-request-does-not-trigger-skill · 2.1.257 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.263 · 1.00 vue-request-does-not-trigger-skill · 2.1.269 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.287 · 0.00 vue-request-does-not-trigger-skill · 2.1.287 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.287 · 1.00 vue-request-does-not-trigger-skill · 2.1.287 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.287 · 1.00 vue-request-does-not-trigger-skill · 2.1.295 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.296 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 vue-request-does-not-trigger-skill · 2.1.258 · 1.00 spring-request-dtos-are-validated-records · 2.1.258 · 0.94 spring-request-dtos-are-validated-records · 2.1.258 · 1.00 spring-request-dtos-are-validated-records · 2.1.263 · 1.00 spring-request-dtos-are-validated-records · 2.1.269 · 1.00 spring-request-dtos-are-validated-records · 2.1.258 · 1.00 spring-request-dtos-are-validated-records · 2.1.287 · 1.00 spring-request-dtos-are-validated-records · 2.1.258 · 1.00 spring-request-dtos-are-validated-records · 2.1.258 · 1.00 spring-request-dtos-are-validated-records · 2.1.258 · 1.00 spring-request-dtos-are-validated-records · 2.1.287 · 0.94 spring-request-dtos-are-validated-records · 2.1.287 · 0.94 spring-request-dtos-are-validated-records · 2.1.258 · 1.00 spring-request-dtos-are-validated-records · 2.1.258 · 1.00 spring-request-dtos-are-validated-records · 2.1.287 · 0.94 spring-request-dtos-are-validated-records · 2.1.295 · 1.00 spring-request-dtos-are-validated-records · 2.1.258 · 1.00 spring-request-dtos-are-validated-records · 2.1.258 · 1.00 spring-request-dtos-are-validated-records · 2.1.296 · 1.00 spring-request-dtos-are-validated-records · 2.1.258 · 1.00 spring-request-dtos-are-validated-records · 2.1.258 · 1.00 spring-request-dtos-are-validated-records · 2.1.258 · 1.00 spring-service-owns-rules-and-errors · 2.1.258 · 1.00 spring-service-owns-rules-and-errors · 2.1.258 · 0.93 spring-service-owns-rules-and-errors · 2.1.263 · 1.00 spring-service-owns-rules-and-errors · 2.1.269 · 1.00 spring-service-owns-rules-and-errors · 2.1.258 · 1.00 spring-service-owns-rules-and-errors · 2.1.287 · 1.00 spring-service-owns-rules-and-errors · 2.1.258 · 1.00 spring-service-owns-rules-and-errors · 2.1.258 · 1.00 spring-service-owns-rules-and-errors · 2.1.258 · 1.00 spring-service-owns-rules-and-errors · 2.1.287 · 1.00 spring-service-owns-rules-and-errors · 2.1.287 · 1.00 spring-service-owns-rules-and-errors · 2.1.258 · 1.00 spring-service-owns-rules-and-errors · 2.1.258 · 1.00 spring-service-owns-rules-and-errors · 2.1.287 · 1.00 spring-service-owns-rules-and-errors · 2.1.295 · 1.00 spring-service-owns-rules-and-errors · 2.1.258 · 0.93 spring-service-owns-rules-and-errors · 2.1.258 · 1.00 spring-service-owns-rules-and-errors · 2.1.296 · 1.00 spring-service-owns-rules-and-errors · 2.1.258 · 1.00 spring-service-owns-rules-and-errors · 2.1.258 · 1.00 spring-service-owns-rules-and-errors · 2.1.258 · 1.00 spring-work-triggers-skill · 2.1.258 · 1.00 spring-work-triggers-skill · 2.1.258 · 1.00 spring-work-triggers-skill · 2.1.263 · 1.00 spring-work-triggers-skill · 2.1.269 · 1.00 spring-work-triggers-skill · 2.1.258 · 1.00 spring-work-triggers-skill · 2.1.287 · 0.00 spring-work-triggers-skill · 2.1.287 · 1.00 spring-work-triggers-skill · 2.1.258 · 1.00 spring-work-triggers-skill · 2.1.258 · 1.00 spring-work-triggers-skill · 2.1.258 · 1.00 spring-work-triggers-skill · 2.1.287 · 1.00 spring-work-triggers-skill · 2.1.287 · 1.00 spring-work-triggers-skill · 2.1.258 · 1.00 spring-work-triggers-skill · 2.1.258 · 1.00 spring-work-triggers-skill · 2.1.287 · 1.00 spring-work-triggers-skill · 2.1.295 · 1.00 spring-work-triggers-skill · 2.1.258 · 1.00 spring-work-triggers-skill · 2.1.258 · 1.00 spring-work-triggers-skill · 2.1.296 · 1.00 spring-work-triggers-skill · 2.1.258 · 1.00 spring-work-triggers-skill · 2.1.258 · 1.00 spring-work-triggers-skill · 2.1.258 · 1.00
guard-blocks-destructive-git spring-controller-follows-conventions vue-request-does-not-trigger-skill spring-request-dtos-are-validated-records spring-service-owns-rules-and-errors spring-work-triggers-skill
Runs
status when track claude code model overall guard-blocks-destructive-git spring-controller-follows-conventions vue-request-does-not-trigger-skill spring-request-dtos-are-validated-records spring-service-owns-rules-and-errors spring-work-triggers-skill cost pass2026-10-16 09:58 pinned 2.1.258 claude-sonnet-5 1.00 1.00 1.00 1.00 1.00 1.00 1.00 $1.38 report pass2026-10-13 14:42 pinned 2.1.258 claude-sonnet-5 1.00 1.00 1.00 1.00 1.00 1.00 1.00 $1.44 report pass2026-10-13 14:31 pinned 2.1.258 claude-sonnet-5 1.00 1.00 1.00 1.00 1.00 1.00 1.00 $1.41 report pass2026-10-12 15:18 canary 2.1.296 — 1.00 1.00 1.00 1.00 1.00 1.00 1.00 $0.92 report pass2026-10-09 14:53 pinned 2.1.258 claude-sonnet-5 1.00 1.00 1.00 1.00 1.00 1.00 1.00 $1.40 report below2026-10-09 14:23 pinned 2.1.258 claude-sonnet-5 0.99 1.00 1.00 1.00 1.00 0.93 1.00 $1.28 report pass2026-10-09 14:05 canary 2.1.295 — 1.00 1.00 1.00 1.00 1.00 1.00 1.00 $0.96 report below2026-10-01 21:28 canary 2.1.287 — 0.99 1.00 1.00 1.00 0.94 1.00 1.00 $0.97 report pass2026-10-01 21:17 pinned 2.1.258 claude-sonnet-5 1.00 1.00 1.00 1.00 1.00 1.00 1.00 $1.35 report pass2026-10-01 21:04 pinned 2.1.258 claude-sonnet-5 1.00 1.00 1.00 1.00 1.00 1.00 1.00 $1.30 report below2026-10-01 20:48 canary 2.1.287 — 0.99 1.00 1.00 1.00 0.94 1.00 1.00 $0.97 report below2026-10-01 20:04 canary 2.1.287 — 0.99 1.00 1.00 1.00 0.94 1.00 1.00 $0.99 report pass2026-10-01 20:00 pinned 2.1.258 claude-sonnet-5 1.00 1.00 1.00 1.00 1.00 1.00 1.00 $1.35 report pass2026-10-01 19:20 pinned 2.1.258 claude-sonnet-5 1.00 1.00 1.00 1.00 1.00 1.00 1.00 $1.31 report pass2026-10-01 19:12 pinned 2.1.258 claude-sonnet-5 1.00 1.00 1.00 1.00 1.00 1.00 1.00 $1.34 report pass2026-10-01 19:03 canary 2.1.287 claude-sonnet-5-5 1.00 1.00 1.00 1.00 1.00 1.00 1.00 $0.23 report errored2026-10-01 18:57 canary 2.1.287 — 0.00 0.00 — 0.00 — — 0.00 $0.00 report pass2026-10-01 18:57 pinned 2.1.258 claude-sonnet-5 1.00 1.00 1.00 1.00 1.00 1.00 1.00 $1.41 report pass2026-09-12 06:21 canary 2.1.269 claude-sonnet-5 1.00 1.00 1.00 1.00 1.00 1.00 1.00 $0.48 report pass2026-09-06 20:25 canary 2.1.263 claude-sonnet-5 1.00 1.00 1.00 1.00 1.00 1.00 1.00 $0.50 report below2026-09-03 18:06 pinned 2.1.258 claude-sonnet-5 0.99 1.00 1.00 1.00 1.00 0.93 1.00 $1.26 report below2026-09-03 17:57 pinned 2.1.258 claude-sonnet-5 0.99 1.00 1.00 1.00 0.94 1.00 1.00 $1.32 report pass2026-09-03 17:00 pinned 2.1.258 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.46 report pass2026-09-03 16:14 pinned 2.1.258 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.49 report pass2026-09-02 18:39 pinned 2.1.258 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.45 report regressed2026-09-02 18:35 pinned 2.1.258 claude-sonnet-5 0.92 0.75 1.00 1.00 — — — $0.45 report pass2026-09-02 17:00 pinned 2.1.258 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.50 report pass2026-09-01 21:02 — 2.1.257 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.38 report pass2026-09-01 05:06 — 2.1.252 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.34 report pass2026-08-27 19:15 — 2.1.247 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.36 report pass2026-08-27 19:00 — 2.1.247 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.35 report pass2026-08-27 18:57 — 2.1.247 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.43 report pass2026-08-27 18:54 — 2.1.247 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.44 report pass2026-08-27 18:49 — 2.1.247 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.41 report pass2026-08-27 17:17 — 2.1.247 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.40 pass2026-08-27 17:09 — 2.1.247 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.40 pass2026-08-27 17:06 — 2.1.247 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.44 pass2026-08-27 16:58 — 2.1.247 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.40 pass2026-08-27 16:55 — 2.1.247 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.40 pass2026-08-27 16:52 — 2.1.247 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.40 pass2026-08-27 16:49 — 2.1.247 claude-sonnet-5 1.00 1.00 1.00 1.00 — — — $0.43