config-drift-checker · Claude Code release report
Claude Code 2.1.295: 11 public suites, 303 cases. 211 load, 0 broke on this release, 92 never loaded
Every public claude plugin eval suite we know of, loaded by the official runner on Claude Code 2.1.295 and on 2.1.287. A case that loaded on 2.1.287 and not on 2.1.295 broke on this release; one that fails on both never loaded. Updated 2026-10-09 14:35 UTC.
Per release
node tools/suite-doctor.mjs <plugin> --fix from a checkout of config-drift-checker to see and repair what the runner rejects, or open an issue to opt out of this report.Suites
3x-haust/oh-my-design
Design cognition loop for Codex, Claude Code, and Pi-compatible agents — frame, diverge, see, reframe
12 cases
| never loaded | award-bar | graders: Required suite-doctor: make it an llm grader: add frontmatter with type: llm and focus: last_message above the rubric, which becomes its criteria (the body) ( --fix applies this), plus 3 more |
| never loaded | blog-multipage | graders: Required suite-doctor: make it an llm grader: add frontmatter with type: llm and focus: last_message above the rubric, which becomes its criteria (the body) ( --fix applies this), plus 3 more |
| never loaded | docs-site | graders: Required suite-doctor: make it an llm grader: add frontmatter with type: llm and focus: last_message above the rubric, which becomes its criteria (the body) ( --fix applies this), plus 3 more |
| never loaded | figma-fidelity | graders: Required suite-doctor: make it an llm grader: add frontmatter with type: llm and focus: last_message above the rubric, which becomes its criteria (the body) ( --fix applies this), plus 3 more |
| never loaded | human-design-loop | graders: Required suite-doctor: make it an llm grader: add frontmatter with type: llm and focus: last_message above the rubric, which becomes its criteria (the body) ( --fix applies this) |
| never loaded | korean-developer-portfolio | graders: Required suite-doctor: make it an llm grader: add frontmatter with type: llm and focus: last_message above the rubric, which becomes its criteria (the body) ( --fix applies this), plus 3 more |
| never loaded | korean-showpiece | graders: Required suite-doctor: make it an llm grader: add frontmatter with type: llm and focus: last_message above the rubric, which becomes its criteria (the body) ( --fix applies this), plus 6 more |
| never loaded | landing-quality | graders: Required |
| never loaded | motion-showpiece | graders: Required suite-doctor: make it an llm grader: add frontmatter with type: llm and focus: last_message above the rubric, which becomes its criteria (the body) ( --fix applies this), plus 3 more |
| never loaded | quiet-dashboard | graders: Required suite-doctor: make it an llm grader: add frontmatter with type: llm and focus: last_message above the rubric, which becomes its criteria (the body) ( --fix applies this) |
| never loaded | reference-synthesis | graders: Required suite-doctor: make it an llm grader: add frontmatter with type: llm and focus: last_message above the rubric, which becomes its criteria (the body) ( --fix applies this) |
| never loaded | scout-only | graders: Required suite-doctor: make it an llm grader: add frontmatter with type: llm and focus: last_message above the rubric, which becomes its criteria (the body) ( --fix applies this), plus 1 more |
jameskomo/config-drift-checker examples/komo-stack
CI for your coding-agent setup (CLAUDE.md, skills, hooks): pinned baselines, a canary on every Claude Code release, self-diagnosing reports, autonomous repair. One suite, three agents: Claude Code,...
6 cases
| loads | guard-blocks-destructive-git | |
| loads | spring-controller-follows-conventions | |
| loads | spring-request-dtos-are-validated-records | |
| loads | spring-service-owns-rules-and-errors | |
| loads | spring-work-triggers-skill | |
| loads | vue-request-does-not-trigger-skill |
owid/skills
Agent Skills for Our World in Data
30 cases
| loads | skills/owid/add-citations | |
| loads | skills/owid/admits-no-chart-exists | |
| loads | skills/owid/answers-with-latest-year | |
| loads | skills/owid/article-to-slides | |
| loads | skills/owid/consistent-with-owid | |
| loads | skills/owid/data-from-url | |
| loads | skills/owid/data-sources-on-topic | |
| loads | skills/owid/explain-spike | |
| loads | skills/owid/explain-term-in-chart | |
| loads | skills/owid/extract-claims | |
| loads | skills/owid/fact-check-article | |
| loads | skills/owid/find-chart | |
| loads | skills/owid/finds-a-map-link | |
| loads | skills/owid/finds-data-insights | |
| loads | skills/owid/how-was-data-produced | |
| loads | skills/owid/html-summary-with-charts | |
| loads | skills/owid/integrate-into-pipeline | |
| loads | skills/owid/is-that-true | |
| loads | skills/owid/licence-non-redistributable | |
| loads | skills/owid/lists-articles-by-author | |
| loads | skills/owid/png-of-chart | |
| loads | skills/owid/reproduce-in-notebook | |
| loads | skills/owid/topic-coverage | |
| loads | skills/owid/trap-filtered-default-selection | |
| loads | skills/owid/trap-map-default-country-filter | |
| loads | skills/owid/trap-multidim-url-params | |
| loads | skills/owid/user-agent-in-python | |
| loads | skills/owid/user-agent-in-shell | |
| loads | skills/owid/utm-on-fetches | |
| loads | skills/owid/whats-interesting |
comedianhhh/job-agent-skills
Job-search workflow for coding agents (North America): 10 Claude Code skills + jobs-mcp for scanning Greenhouse / Lever / Ashby / LinkedIn
21 cases
| loads | career-init/existing-workspace-not-overwritten | |
| loads | career-init/scaffold-fresh-workspace | |
| loads | contributor/ai-disclosure-policy-surfaced | |
| loads | contributor/no-external-writes-without-confirmation | |
| loads | evidence-recap/nine-parts-prototype-stage | |
| loads | evidence-recap/refuses-to-inflate-stage | |
| loads | great-resume/linkedin-note-under-limit | |
| loads | great-resume/rewrite-bullets-from-facts | |
| loads | interview/grill-one-question-per-turn | |
| loads | interview/predict-questions-for-acme | |
| loads | job-apply/missing-materials-route-to-make-resume | |
| loads | job-apply/portal-handled-by-user | |
| loads | job-match/jd-fit-matrix | |
| loads | job-match/title-only-asks-for-jd | |
| loads | make-resume/tailor-from-master-with-tbd | |
| loads | make-resume/wording-only-does-not-touch-files | |
| loads | offer/receipt-is-applied-not-screen | |
| loads | offer/rejection-email-updates-row | |
| loads | offer/scan-without-jobs-mcp | |
| loads | project-guide/course-needs-source-code | |
| loads | project-guide/interview-material-from-description |
CodeWarrior-debug/perspectize
When 'like' is not enough : collect, refine, compare, and share your perspectives with all (or none) of the nuances in your mind. On YouTube videos, for starters :)
3 cases
| loads | claude-md-audit/evals/planted-defects | |
| loads | claude-md-audit/evals/real-repo-snapshot | |
| loads | claude-md-audit/evals/subtle-defects |
Ahmed-G-Gad/apothem
Host-agnostic configuration manager — author one shared profile (rules, skills, hooks, slash-commands, MCP servers) and materialize it into the native config of seventeen assistant harnesses (Claud...
108 cases
| loads | outcomes/audit/outcome-a11y-audit | |
| loads | outcomes/audit/outcome-architecture-review | |
| loads | outcomes/audit/outcome-code-audit | |
| loads | outcomes/audit/outcome-code-review | |
| loads | outcomes/audit/outcome-dependency-audit | |
| loads | outcomes/audit/outcome-docs-review | |
| loads | outcomes/audit/outcome-perf-audit | |
| loads | outcomes/audit/outcome-security-audit | |
| loads | outcomes/audit/outcome-supply-chain-audit | |
| loads | outcomes/audit/outcome-threat-model-audit | |
| loads | outcomes/audit/outcome-ux-review | |
| loads | outcomes/plan/outcome-plan-amend | |
| loads | outcomes/plan/outcome-plan-audit | |
| loads | outcomes/plan/outcome-plan-design | |
| loads | outcomes/plan/outcome-plan-execute | |
| loads | outcomes/plan/outcome-plan-generate | |
| loads | outcomes/plan/outcome-plan-review | |
| loads | outcomes/plan/outcome-plan-spec | |
| loads | outcomes/plan/outcome-plan-status | |
| loads | outcomes/research/outcome-research-analysis | |
| loads | outcomes/research/outcome-research-design | |
| loads | outcomes/research/outcome-research-disseminate | |
| loads | outcomes/research/outcome-research-experiment | |
| loads | outcomes/research/outcome-research-ideate | |
| loads | outcomes/research/outcome-research-paper | |
| loads | outcomes/research/outcome-research-proposal | |
| loads | outcomes/research/outcome-research-publish | |
| loads | outcomes/research/outcome-research-review | |
| loads | outcomes/research/outcome-research-sources | |
| loads | outcomes/research/outcome-research-spec | |
| loads | outcomes/research/outcome-research-synthesis | |
| loads | outcomes/research/outcome-research-theory | |
| loads | rules/rule-authority-inquiry-off | |
| loads | rules/rule-authority-inquiry-on | |
| loads | rules/rule-definitiveness-off | |
| loads | rules/rule-definitiveness-on | |
| loads | rules/rule-freshness-facade-off | |
| loads | rules/rule-freshness-facade-on | |
| loads | rules/rule-interactive-questions-off | |
| loads | rules/rule-interactive-questions-on | |
| loads | rules/rule-option-annotation-off | |
| loads | rules/rule-option-annotation-on | |
| loads | rules/rule-session-closure-off | |
| loads | rules/rule-session-closure-on | |
| loads | triggers/no-auto-trigger-freshify | |
| loads | triggers/no-auto-trigger-github-deploy-fresh | |
| loads | triggers/no-auto-trigger-github-deploy-next | |
| loads | triggers/no-trigger-codebase-explorer | |
| loads | triggers/no-trigger-convention-auditor | |
| loads | triggers/no-trigger-dependency-auditor | |
| loads | triggers/no-trigger-fact-checker | |
| loads | triggers/no-trigger-freshify | |
| loads | triggers/no-trigger-github-deploy-fresh | |
| loads | triggers/no-trigger-github-deploy-next | |
| loads | triggers/no-trigger-mcp-builder | |
| loads | triggers/no-trigger-memory-auditor | |
| loads | triggers/no-trigger-plan-amend | |
| loads | triggers/no-trigger-plan-audit | |
| loads | triggers/no-trigger-plan-design | |
| loads | triggers/no-trigger-plan-execute | |
| loads | triggers/no-trigger-plan-generate | |
| loads | triggers/no-trigger-plan-review | |
| loads | triggers/no-trigger-plan-spec | |
| loads | triggers/no-trigger-plan-status | |
| loads | triggers/no-trigger-prompt-evaluator | |
| loads | triggers/no-trigger-quality-gate | |
| loads | triggers/no-trigger-refactor-surgeon | |
| loads | triggers/no-trigger-research-analysis | |
| loads | triggers/no-trigger-research-design | |
| loads | triggers/no-trigger-research-experiment | |
| loads | triggers/no-trigger-research-paper | |
| loads | triggers/no-trigger-research-publish | |
| loads | triggers/no-trigger-research-review | |
| loads | triggers/no-trigger-research-scout | |
| loads | triggers/no-trigger-research-sources | |
| loads | triggers/no-trigger-research-spec | |
| loads | triggers/no-trigger-research-synthesis | |
| loads | triggers/no-trigger-security-scanner | |
| loads | triggers/no-trigger-test-runner | |
| loads | triggers/trigger-codebase-explorer | |
| loads | triggers/trigger-convention-auditor | |
| loads | triggers/trigger-dependency-auditor | |
| loads | triggers/trigger-fact-checker | |
| loads | triggers/trigger-mcp-builder | |
| loads | triggers/trigger-memory-auditor | |
| loads | triggers/trigger-plan-amend | |
| loads | triggers/trigger-plan-audit | |
| loads | triggers/trigger-plan-design | |
| loads | triggers/trigger-plan-execute | |
| loads | triggers/trigger-plan-generate | |
| loads | triggers/trigger-plan-review | |
| loads | triggers/trigger-plan-spec | |
| loads | triggers/trigger-plan-status | |
| loads | triggers/trigger-prompt-evaluator | |
| loads | triggers/trigger-quality-gate | |
| loads | triggers/trigger-refactor-surgeon | |
| loads | triggers/trigger-research-analysis | |
| loads | triggers/trigger-research-design | |
| loads | triggers/trigger-research-experiment | |
| loads | triggers/trigger-research-paper | |
| loads | triggers/trigger-research-publish | |
| loads | triggers/trigger-research-review | |
| loads | triggers/trigger-research-scout | |
| loads | triggers/trigger-research-sources | |
| loads | triggers/trigger-research-spec | |
| loads | triggers/trigger-research-synthesis | |
| loads | triggers/trigger-security-scanner | |
| loads | triggers/trigger-test-runner |
23 cases
| loads | archive/auto-questionnaire-before-action | |
| loads | archive/coordinator-explore-then-ask | |
| loads | archive/doc-validator-clean | |
| loads | archive/document-validator-scope-overclaim | |
| loads | archive/external-clis-attribution | |
| loads | archive/external-clis-clone-isolation | |
| loads | archive/external-clis-clone-lifecycle | |
| loads | archive/external-clis-distinct-findings | |
| loads | archive/external-clis-document-merge-blocker | |
| loads | archive/external-clis-document-only | |
| loads | archive/external-clis-merge-blocker | |
| loads | archive/external-clis-missing-binary | |
| loads | archive/external-clis-only | |
| loads | archive/external-clis-parallel | |
| loads | archive/external-clis-security-merge-blocker | |
| loads | archive/external-clis-security-only | |
| loads | archive/external-clis-transport-failure | |
| loads | archive/plan-loop-no-cli-fallback | |
| loads | cases/auto-hard-stop-recorded-state | |
| loads | cases/code-reviewer-equivalent-form-miss | |
| loads | cases/doc-validator-gap | |
| loads | cases/external-clis-risk-001 | |
| loads | cases/security-reviewer-object-authz-miss |
evisoft/scio.md.plugin
Scio plugin: search, cite and contribute to the agent-written encyclopedia through its OAuth MCP server
6 cases
| loads | gap-offer | |
| loads | injected-panel | |
| loads | no-register | |
| loads | research-sources | |
| loads | review-paged-panel | |
| loads | review-seat |
11 cases
| loads | evidence-in-report | |
| loads | keep-going | |
| loads | no-hand-back | |
| loads | no-menu | |
| loads | pycheck-edit-existing | |
| loads | pycheck-neg-markdown | |
| loads | pycheck-neg-question | |
| loads | pycheck-optional-return | |
| loads | pycheck-pasted-latent-bug | |
| loads | pycheck-wrong-arg-type | |
| loads | spawn-contract |
lukassykora/drupal-superpowers
Claude Code Superpowers for Drupal.
80 cases
| never loaded | acceptance/01-saved-items-endpoint | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | acceptance/02-previous-user-data | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | acceptance/03-upgrade-10-to-11 | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | acceptance/04-form-validation-no-docker | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | acceptance/05-mcp-introspection | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | agents/no-duplicate-research | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | agents/no-subagent-for-trivial | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 2 more |
| never loaded | integration/d10-deprecations-real-phpstan | invalid YAML frontmatter: YAML Parse error: Unexpected token suite-doctor: remove project_env: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 2 more |
| never loaded | integration/d10-wrong-version-real-core | invalid YAML frontmatter: YAML Parse error: Unexpected token suite-doctor: remove project_env: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 2 more |
| never loaded | integration/d11-cache-kernel-test-real | unknown frontmatter key "project_env" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove project_env: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 3 more |
| never loaded | integration/d11-dangerous-in-lab | unknown frontmatter key "project_env" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove project_env: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | integration/d11-debugging-real-container | unknown frontmatter key "project_env" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove project_env: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 3 more |
| never loaded | integration/d11-form-validation-real | unknown frontmatter key "project_env" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove project_env: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 3 more |
| never loaded | integration/d11-runtime-verification-real | unknown frontmatter key "project_env" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove project_env: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | integration/ddev-plan-real-core | unknown frontmatter key "project_env" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove project_env: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 9 more |
| never loaded | integration/ddev-saved-list-real-test | unknown frontmatter key "project_env" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove project_env: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 4 more |
| never loaded | no-trigger/drupal-architecture | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-cacheability | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-code-review | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-config | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-contrib-research | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-debugging | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-frontend | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-hard-problem | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-migrate-api | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-module-development | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-performance | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-project-understanding | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-research | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-runtime-verification | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-security | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-setup-mcp | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-tailwind | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-testing | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-upgrade | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-verification | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | no-trigger/drupal-workflow | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | scenarios/cache | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | scenarios/create-module | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | scenarios/dangerous-env | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | scenarios/debugging | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | scenarios/english-code | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 4 more |
| never loaded | scenarios/fake-api | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | scenarios/frontend | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 3 more |
| never loaded | scenarios/git-handoff | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 2 more |
| never loaded | scenarios/git-on-request | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 2 more |
| never loaded | scenarios/legacy | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 2 more |
| never loaded | scenarios/mcp-absent | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | scenarios/mcp-present | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | scenarios/migrate | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 2 more |
| never loaded | scenarios/performance | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 2 more |
| never loaded | scenarios/plan-real-code | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 6 more |
| never loaded | scenarios/regression-test | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | scenarios/runtime-ddev | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | scenarios/runtime-none | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | scenarios/security | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 2 more |
| never loaded | scenarios/tailwind-scan-surface | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 4 more |
| never loaded | scenarios/upgrade | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 2 more |
| never loaded | scenarios/wrong-version | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-architecture | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 2 more |
| never loaded | trigger/drupal-cacheability | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-code-review | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-config | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-contrib-research | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-debugging | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-frontend | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-hard-problem | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-migrate-api | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-module-development | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-performance | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-project-understanding | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-research | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-runtime-verification | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-security | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-setup-mcp | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-tailwind | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-testing | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-upgrade | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) |
| never loaded | trigger/drupal-verification | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
| never loaded | trigger/drupal-workflow | unknown frontmatter key "fixture" (expected one of: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env) suite-doctor: remove fixture: (allowed: schema_version, name, description, tags, plugins, runs, expected_outcome, model, max_turns, timeout_seconds, allowed_tools, artifact_publish, growthbook_overrides, append_system_prompt, env), plus 1 more |
roselabs-io/pro-code
Agent-amplified software pipeline (Frame → Plan → Implement), gated by graders. Two runnable example services + the reading map behind it.
3 cases
| loads | frame-completeness | |
| loads | plan-completeness | |
| loads | profile-completeness |
How this is checked: each repo is cloned at depth 1 (no submodules, no LFS) and the suite is loaded by claude plugin eval --max-cost-usd 0 --trust-plugin --no-publish in a bare environment with an empty HOME and no credentials. The cost ceiling stops the run before any agent starts, so no model runs and nothing is spent; nothing from the repo is installed or executed. The error shown is the runner's own first message for the case; the fix line comes from suite-doctor's static rules. Suites are found through GitHub code search and an explicit list; 3 other repos matched the search but hold evals for a different harness and are not listed. Data: report.json, history in archive/. Generated by config-drift-checker.