Skip to content

Add the ten poka-yoke specialist skills - #2808

Open
rainmanjam wants to merge 3 commits into
github:mainfrom
rainmanjam:add-poka-yoke-specialist-skills
Open

Add the ten poka-yoke specialist skills#2808
rainmanjam wants to merge 3 commits into
github:mainfrom
rainmanjam:add-poka-yoke-specialist-skills

Conversation

@rainmanjam

@rainmanjam rainmanjam commented Aug 26, 2026

Copy link
Copy Markdown
Contributor

Second submission, following #2792 which added poka-yoke — the router. This adds the ten
modes it routes to, and updates the router to name them.

Skill For
poka-yoke-design A new API, schema, type or state machine — make misuse unrepresentable
poka-yoke-audit Existing code: swappable arguments, silent fallbacks, unguarded deletes
poka-yoke-retro After an incident, when the fix must close the class rather than the case
poka-yoke-guardrails Pre-commit hooks, CI gates, lint rules, database constraints
poka-yoke-agent-guardrails Constraining an AI agent that works on your repository
poka-yoke-authz Multi-tenant isolation, IDOR, row-level security
poka-yoke-data Pipelines and metrics, where failure is silently wrong numbers
poka-yoke-ops Deploys, migrations, rollback, blast radius
poka-yoke-llm AI features you ship to users: structured output, tool schemas, injection
poka-yoke-ux Forms, destructive actions, flows users get wrong

The router is updated too. As merged it described its modes but never named them as
installable skills, so a reader had no way to discover poka-yoke-audit and the rest. It now
carries a table of all ten, the llm / agent-guardrails distinction, and a note that they
compose — an incident involving a bad migration is poka-yoke-retro for the analysis and
poka-yoke-ops for the device.

How they were built

Derived from the upstream plugin by a script rather than hand-copied, so a later refresh is a
re-run. Upstream shares one references/ and scripts/ tree across all skills; your skills
are self-contained folders, so each got a copy of exactly the files its own SKILL.md
names
— no more. Four need no bundled files at all.

Verified before pushing

Check Result
node eng/validate-skills.mjs ✅ all 424 skills valid
That the validator covers the new skills Broke poka-yoke-audit's frontmatter name → named in the output, exit 1; restored → exit 0
codespell on all eleven ✅ clean
Router names exactly the skills present 10 named, 10 folders, no orphans either way
Every bundled path resolves inside its own folder 11 checked, no ../ escapes
docs/README.skills.md Regenerated with eng/update-readme.mjs

Two codespell failures were fixed upstream at source rather than patched here, so the
plugin and these skills cannot drift: four regex alternation stems that read as typos to a
spell checker (coalesc, doesn', (mis)?use twice) and one pre-selectedpreselected.
I found the second by running codespell locally rather than waiting for another CI round trip.

On scope

Ten entries from one author is a lot to land at once. Happy to split this into separate PRs,
trim to the most broadly useful three or four (design, audit, retro, guardrails), or
drop it if the router alone is the right footprint. Say the word and I will restructure.

Upstream: https://github.com/rainmanjam/poka-yoke (v0.2.0)

The merged poka-yoke skill is the router. These are the ten modes it routes to,
each self-contained with only the reference files and scripts its own SKILL.md
names.

Derived from the upstream plugin rather than hand-copied, so a refresh is a
re-run. Verified: no path escapes its skill folder, every bundled path resolves,
each frontmatter name matches its directory, and validate-skills.mjs passes on
all 424.
Copilot AI balanced review requested due to automatic review settings August 26, 2026 01:06

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@github-actions github-actions Bot added new-submission PR adds at least one new contribution skills PR touches skills labels Aug 26, 2026
@github-actions

github-actions Bot commented Aug 26, 2026

Copy link
Copy Markdown
Contributor

🔒 PR Risk Scan Results

Scanned 30 changed file(s).

Severity Count
🔴 High 0
🟠 Medium 1
ℹ️ Info 7
Severity Rule File Line Match
ℹ️ skill-script-touched skills/poka-yoke-agent-guardrails/assets/devices/claude-hooks/guard_dangerous_commands.py 1 skills/poka-yoke-agent-guardrails/assets/devices/claude-hooks/guard_dangerous_commands.py
ℹ️ skill-script-touched skills/poka-yoke-agent-guardrails/assets/devices/claude-hooks/suggest_poka_yoke.py 1 skills/poka-yoke-agent-guardrails/assets/devices/claude-hooks/suggest_poka_yoke.py
ℹ️ skill-script-touched skills/poka-yoke-audit/scripts/detect_hazards.py 1 skills/poka-yoke-audit/scripts/detect_hazards.py
ℹ️ skill-script-touched skills/poka-yoke-audit/scripts/device_registry.py 1 skills/poka-yoke-audit/scripts/device_registry.py
ℹ️ skill-script-touched skills/poka-yoke-guardrails/assets/devices/claude-hooks/guard_dangerous_commands.py 1 skills/poka-yoke-guardrails/assets/devices/claude-hooks/guard_dangerous_commands.py
ℹ️ skill-script-touched skills/poka-yoke-guardrails/assets/devices/claude-hooks/suggest_poka_yoke.py 1 skills/poka-yoke-guardrails/assets/devices/claude-hooks/suggest_poka_yoke.py
🟠 package-exec-command skills/poka-yoke-guardrails/assets/devices/github-actions/poka-yoke-gates.yml 53 # - run: npx tsc --noEmit
ℹ️ skill-script-touched skills/poka-yoke-retro/scripts/detect_hazards.py 1 skills/poka-yoke-retro/scripts/detect_hazards.py

This is an automated soft-gate report. Findings indicate review targets and do not block merge by themselves.

@github-actions

github-actions Bot commented Aug 26, 2026

Copy link
Copy Markdown
Contributor

🟡 Contributor Reputation Check: MEDIUM risk

Check Risk
Profile MEDIUM
Credential audit NONE

Maintainers: please review this contributor before merging.
See the workflow run for full details.
Automated check powered by AGT.

@github-actions github-actions Bot added the needs-review:MEDIUM Contributor reputation check flagged MEDIUM risk label Aug 26, 2026
@github-actions

github-actions Bot commented Aug 26, 2026

Copy link
Copy Markdown
Contributor

🔍 Vally Lint Results

✅ All checks passed

Scope Checked
Skills 11
Agents 0
Total 11
Severity Count
❌ Errors 0
⚠️ Warnings 0
ℹ️ Advisories 0

Summary

Level Finding
ℹ️ ✅ poka-yoke-agent-guardrails (2/2 checks passed)
ℹ️ ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
ℹ️ ✓ spec-compliance: All spec checks passed.
ℹ️ ✓ [valid-refs] All file references across 1 skill(s) are valid.
ℹ️ ✓ valid-refs: All file references resolve to existing files within the skill directory.
ℹ️ 1 skill(s) linted, 1 passed
ℹ️ ✅ poka-yoke-audit (2/2 checks passed)
ℹ️ ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
ℹ️ ✓ spec-compliance: All spec checks passed.
ℹ️ ✓ [valid-refs] All file references across 1 skill(s) are valid.
Full linter output
### Linting skills/poka-yoke-agent-guardrails
✅ poka-yoke-agent-guardrails (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.

1 skill(s) linted, 1 passed

### Linting skills/poka-yoke-audit
✅ poka-yoke-audit (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.

1 skill(s) linted, 1 passed

### Linting skills/poka-yoke-authz
✅ poka-yoke-authz (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.

1 skill(s) linted, 1 passed

### Linting skills/poka-yoke-data
✅ poka-yoke-data (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.

1 skill(s) linted, 1 passed

### Linting skills/poka-yoke-design
✅ poka-yoke-design (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.

1 skill(s) linted, 1 passed

### Linting skills/poka-yoke-guardrails
✅ poka-yoke-guardrails (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.

1 skill(s) linted, 1 passed

### Linting skills/poka-yoke-llm
✅ poka-yoke-llm (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.

1 skill(s) linted, 1 passed

### Linting skills/poka-yoke-ops
✅ poka-yoke-ops (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.

1 skill(s) linted, 1 passed

### Linting skills/poka-yoke-retro
✅ poka-yoke-retro (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.

1 skill(s) linted, 1 passed

### Linting skills/poka-yoke-ux
✅ poka-yoke-ux (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.

1 skill(s) linted, 1 passed

### Linting skills/poka-yoke
✅ poka-yoke (2/2 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.

1 skill(s) linted, 1 passed

Four regex alternation stems and one hyphenation, all corrected upstream and
re-derived. Verified locally with codespell and validate-skills before pushing
rather than waiting for another CI round trip.
Copilot AI review requested due to automatic review settings August 26, 2026 01:13

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

The merged poka-yoke skill describes its modes but never named them as installable
skills, so a reader had no way to discover poka-yoke-audit and the rest. Adds a
table naming all ten, the llm/agent-guardrails distinction, and a note that they
compose.

This makes the PR contain all eleven skills: the router plus the ten it routes to.
Copilot AI review requested due to automatic review settings August 26, 2026 01:26

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@aaronpowell

Copy link
Copy Markdown
Contributor

Having a review of these skills, they are overly wordy for what they are trying to achieve. This can be detrimental to the performance of the agent. The original contribution from #2792 was also a bit on the wordy side, but given that it was a more generalist skill, that can be acceptable.

Additionally, the skills rely heavily on Claude design patterns, suggesting that they are lifted straight from a Claude environment. For example, one of the skills relies on the .claude/settings.json and then ships some manual invocation of hooks to perform tool restrictions. Tool restrictions can be applied at a skill level with allowed-tools frontmatter.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

needs-review:MEDIUM Contributor reputation check flagged MEDIUM risk new-submission PR adds at least one new contribution skills PR touches skills

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants