feat: optimize ce:compound speed and effectiveness#370
Conversation
… compliance Merge Category Classifier into Context Analyzer (inline schema enums and category mapping), merge Prevention Strategist into Solution Extractor, and add grep-first filtering to Related Docs Finder. Also add gh CLI preference for GitHub issue search with MCP fallback. Benchmarked across 3 test scenarios (N+1 query, Stimulus race condition, Stripe integration). Results show 33% faster average duration and 100% schema enum compliance vs 33% with the old 5-subagent version, with equivalent quality scores (8.3/9 both versions).
ce:compound speed and effectiveness
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: a032ea917c
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
Address PR review feedback:
- Replace Claude-specific `Grep` tool name with capability-based
description ("native content-search tool") per AGENTS.md convention
- Change `[keyword]` regex placeholders to `<keyword>` angle-bracket
templates to avoid regex character class interpretation
Same fix as ce:compound SKILL.md -- replace Claude-specific Grep tool name with capability-based "native content-search tool" descriptions per AGENTS.md convention.
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 7dabcdc883
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
gh issue list defaults to open issues only, missing relevant closed issues when documenting solved problems. Add --state all to include closed issues in related-issue discovery.
Summary
This improves
ce:compoundso it runs more quickly and is more accurate to boot.ghCLI preference for GitHub issue search with MCP/skip fallback. This mimics what we did forlearnings-analyst.Benchmark Results
Tested across 3 scenarios: N+1 query fix, Stimulus/Turbo race condition, and Stripe integration issue. Each scenario was run with both the old (5-subagent) and new (3-subagent) skill versions.
Speed
Token Usage
Schema Compliance (the big win)
problem_typeuses valid enumcomponentuses valid enumThe old version invented values like
race_condition,billing, andapp/javascript/controllers/dashboard_controller.jsinstead of using schema enums. The new version uses correct values every time because the enums are inline in the Context Analyzer instructions.Quality Scores (9 assertions per output)
Quality is equivalent. The NEW version's 8/9 on N+1 was a missing
category:frontmatter field -- fixed in this PR by explicitly requiring it in the Context Analyzer return spec.Other
Snuck in a quick fix for
learnings-reseacherto be tool agnostic so it works cross agent.Test plan
/ce:compoundafter solving a problem and verify 3 subagents are spawned (not 5)category:field in YAML frontmatterproblem_typeandcomponentuse valid schema enum values/ce:compound --compactand verify compact mode still works (unchanged)