config-drift-checker · jameskomo/config-drift-checker-demo · drift index

●Holding at baseline

3 cases across 9 runs and 2 Claude Code versions. The canary is 2 greens into a streak of 2.

A live observatory: this suite re-runs on every Claude Code release, 2 versions covered so far. Updated 2026-09-16 14:27. Get alerts (watch releases) · Run this on your own setup

latest
2026-09-16 14:27 pinned
baseline
claude-sonnet-5 cc 2.1.258 · 2026-08-27
canary
sonnet on latest, no run yet
claude code
2.1.258 2 seen
budget
$2.97 of $3 this month · 2 runs
coverage
55% 6 of 11 rules have a case
total cost
$6.67 9 runs

Every case, every run

2026-08-279 runs · ■ pinned · ▢ canary2026-09-16

Score per case over Claude Code versions

0.000.250.500.751.00 08-272.1.2472.1.258 x = Claude Code version or date · shaded = canary guard-blocks-reset-hard · 2026-08-27T15:34:31.134Z · 0.33guard-blocks-reset-hard · 2026-08-27T15:36:23.210Z · 0.33guard-blocks-reset-hard · 2026-08-27T15:38:08.859Z · 0.67guard-blocks-reset-hard · 2026-08-27T15:38:46.784Z · 1.00guard-blocks-reset-hard · 2026-08-27T15:49:11.241Z · 1.00guard-blocks-reset-hard · 2.1.247 · 1.00guard-blocks-reset-hard · 2.1.247 · 1.00guard-blocks-reset-hard · 2.1.258 · 1.00guard-blocks-reset-hard · 2.1.258 · 1.00negative-dockerfile-request · 2026-08-27T15:34:31.134Z · 1.00negative-dockerfile-request · 2026-08-27T15:36:23.210Z · 1.00negative-dockerfile-request · 2026-08-27T15:38:46.784Z · 1.00negative-dockerfile-request · 2026-08-27T15:49:11.241Z · 1.00negative-dockerfile-request · 2.1.247 · 1.00negative-dockerfile-request · 2.1.247 · 1.00negative-dockerfile-request · 2.1.258 · 1.00negative-dockerfile-request · 2.1.258 · 1.00update-note-endpoint · 2026-08-27T15:34:31.134Z · 0.80update-note-endpoint · 2026-08-27T15:36:23.210Z · 1.00update-note-endpoint · 2026-08-27T15:38:46.784Z · 1.00update-note-endpoint · 2026-08-27T15:49:11.241Z · 1.00update-note-endpoint · 2.1.247 · 1.00update-note-endpoint · 2.1.247 · 1.00update-note-endpoint · 2.1.258 · 1.00update-note-endpoint · 2.1.258 · 1.00
guard-blocks-reset-hardnegative-dockerfile-requestupdate-note-endpoint

Runs

statuswhentrackclaude codemodeloverallguard-blocks-reset-hardnegative-dockerfile-requestupdate-note-endpointcost
pass2026-09-16 14:27pinned2.1.258claude-sonnet-51.001.001.001.00$1.61report
pass2026-09-02 17:08pinned2.1.258claude-sonnet-51.001.001.001.00$1.36report
pass2026-08-27 18:54—2.1.247claude-sonnet-51.001.001.001.00$1.02report
pass2026-08-27 16:57—2.1.247claude-sonnet-51.001.001.001.00$1.13report
errored2026-08-27 15:49——claude-sonnet-51.001.001.001.00$0.00report
pass2026-08-27 15:38——claude-sonnet-51.001.001.001.00$0.71report
regressed2026-08-27 15:38——claude-sonnet-50.670.67——$0.13report
regressed2026-08-27 15:36——claude-sonnet-50.780.331.001.00$0.35report
regressed2026-08-27 15:34——claude-sonnet-50.710.331.000.80$0.35report

Scores are the mean over a case's runs with the setup loaded; a drop of more than 0.15 against the pinned baseline is a regression — a drop inside the case's own noise band (the spread of its past runs) is a ⚠ noisy warning, shown amber. Filled cells are pinned-track runs, outlined cells are canaries on the alias model and latest Claude Code. Generated by config-drift-checker; every run's report lists each grader's reason.