inspector/.claude/skills
Repository files (latest commit first)
Filename Latest commit message Latest commit date
cliffhall 26d70e00e7 chore: make issue-create and issue-triage model-invocable
`release` is now the only skill reachable by name alone, which is right: nobody
cuts a release by implication, whereas "file an issue for this" and "triage the
new issues" are both ordinary prose instructions.

Eval cases committed for both; each measured 5/5 at RUNS=3. One initial case
was rebuilt rather than tuned: "file an issue for the flaky Storybook test"
scored 0% because its SUBJECT was unresolved — the model went off grepping for
which test was flaky instead of reaching for the filing procedure. A trigger
case must not make the model investigate before it can act.

The full eval across all nine model-invoked skills reports a cost worth having
in writing, and it contradicts the justification given for the previous flip.
Every negative case still passes 100%, so there is no over-triggering — but the
skills that were already model-invoked measurably LOST trigger rate:
`project-structure` fell from 100% to 0% on two cases (n=4) and `testing` from
3/5 to 2/5, while all six newly flipped skills measured 100%.

So the ceiling is attention, not characters: the listing sat at 2.8k of 4k
throughout, and "the budget is not tight" was the wrong reason to think flipping
was free. AGENTS.md now records this, and requires the FULL eval to be re-run
after any flip rather than just the new skill's own cases.

Two of project-structure's three cases are also the invalid-case pattern this
file already documents — `core/auth/` is described in the AGENTS.md tree, so a
model answering "which package owns the secret storage backends" without a skill
is correct rather than failing. `testing`'s cases are not, and it was the weaker
of the two before this change as well.

Signed-off-by: cliffhall <cliff@futurescale.com>
2026-08-30 00:40:21 -04:00
..
board-ops chore: make the workflow skills model-invocable 2026-08-30 00:00:14 -04:00
issue-create chore: make issue-create and issue-triage model-invocable 2026-08-30 00:40:21 -04:00
issue-triage chore: make issue-create and issue-triage model-invocable 2026-08-30 00:40:21 -04:00
local-dev chore: address Copilot review round 15 2026-08-29 04:24:48 -04:00
pr-flow chore: make the workflow skills model-invocable 2026-08-30 00:00:14 -04:00
pre-push-gate chore: make the workflow skills model-invocable 2026-08-30 00:00:14 -04:00
project-structure Merge branch 'v2/main' into v2/chore/2163-agent-skills 2026-08-29 23:06:01 -04:00
release chore: address Copilot review round 18 2026-08-29 05:05:47 -04:00
test-servers chore: make the workflow skills model-invocable 2026-08-30 00:00:14 -04:00
testing chore: extract AGENTS.md recipes into agent skills 2026-08-29 00:36:37 -04:00