Kit review backlog
Open findings from kit-value-and-model-agnostic-review.md (refreshed 2026-09-01). Track work here; mark items done with a PR reference.
P0: honesty / prove-what-you-claim
No open P0 items. R1 (rename) and R2 (Cursor-first copy) are in Done below. Remaining skill-trigger work is asserting required_patterns (product, not copy).
P1: eval / CI proof
| ID | Finding | Proposed action | Status |
|---|
| R3 | Merge gate is scripted-only; nightly live skips without KIT_EVAL_API_KEY | Keep scripted as default; document required secrets for live; optionally fail a scheduled job loudly when key missing in production kit repos | Open (docs clearer; ops still optional) |
| R4 | Live client is OpenAI-compatible only; ANTHROPIC_API_KEY as bearer is easy to misconfigure | Document gateways honestly; consider native Anthropic/Gemini adapters only if demand appears | Open |
P2: maintainability / adoption
| ID | Finding | Proposed action | Status |
|---|
| R5 | Role skills over ~150-line kit-review budget (agent-prune, agent-orchestrator, agent-debug, agent-copy) | Move procedure back to SOPs; keep role skills as routers | Open |
| R6 | Several lang-* / framework-* skills are short checklists (~38–48 lines) | Cut unused profiles or deepen with evals + concrete anti-patterns (see lang-typescript direction) | Open |
| R7 | Full lifecycle ceremony is heavy for day-to-day coding | Keep shortcuts (debug route, light XFN); surface “minimal path” in README onboarding | Open |
Done since Aug 30 draft (do not reopen without new evidence)
| ID | Finding | Resolution |
|---|
| D1 | Architecture stack felt non-optional / blocks adoption | Applicability & opt-out + seed ADRs (#36) |
| D2 | EDD closed-loop entirely aspirational | Suites/depth (#23), shadow/OTel path (#28–#30), skill coverage (#31), nightly live workflow |
| R1 | “Live trigger” language for a non-model skill-registration check | Renamed CLI help + harness banner to skill-trigger / prompt hygiene. Harness still ignores required_patterns. |
| R2 | Multi-IDE peer-depth oversold | FAQ, llms.txt, EDD guide, and README: Cursor is the reference host; other IDEs get thin AGENTS.md stubs. |
How to use
- Prefer small PRs that close one ID.
- Link the ID in the PR body (
Closes review backlog R1).
- When closing an item, set Status to
Done (PR #N) and leave one line of evidence.
