review

star 0

Run final Pi review. Executes the full verification suite, performs holistic evaluation, and presents the scorecard with any remaining repair guidance.

abpai By abpai schedule Updated 6/3/2026

name: review disable-model-invocation: true metadata: internal: true description: Review a Pi run after /pi:execute. Run the full verification suite, perform holistic evaluation, and present the final scorecard with any remaining repair guidance. argument-hint: "[optional task id or filter]" allowed-tools: > Bash(git status ) Bash(git diff ) Bash(git log ) Bash(git branch ) Bash(git rev-parse ) Bash(codex ) Bash(gemini ) Bash(cat .agents/work/) Bash(cat .agents/work/runs//) Bash(cat .agents/work/runs///) Bash(cat .agents/work/runs////) Bash(ls .agents/work/) Bash(ls .agents/work/runs/) Bash(ls .agents/work/runs//) Bash(ls .agents/work/runs///) Read Write Edit Grep Glob

Pi state snapshot

echo "PI_REVIEW_PREFLIGHT_$(date +%s%N)"
git rev-parse --show-toplevel 2>/dev/null || echo "not a git repo"
git branch --show-current 2>/dev/null
git status --short 2>/dev/null | head -30
test -f .agents/work/current.json && cat .agents/work/current.json || echo "no active run"
ls -1 .agents/work/runs 2>/dev/null || echo "no runs"
timeout 3 codex --version 2>&1 || echo "codex: not installed"
timeout 3 gemini --version 2>&1 || echo "gemini: not installed"

The block above runs at skill-load time. Use its output to confirm the brief and tasks exist for the selected run before starting the full verification suite, and to gate the final Codex review on CLI availability. The coordinator must still resolve the run and re-read its state.json before acting.

Read the Pi protocol module (internal/protocol/README.md in this plugin) and execute Phase 3: Review.

User input: $ARGUMENTS

Active state root: .agents/work/runs/<slug>/ via .agents/work/current.json

Coordinator Pipeline

You (the main thread) are the coordinator. Subagents cannot spawn other subagents, so you own all agent orchestration.

Phase A — Load and Verify Prerequisites

  1. Resolve the active run:
    • Read .agents/work/current.json if present and use its slug.
    • If current.json is missing and exactly one run exists under .agents/work/runs/, auto-select it and continue.
    • Otherwise stop and tell the user to run /pi:plan to select or create a run.
  2. Read state.json from the resolved state_root. If phase is not execute or later (review, done), tell the user to run /pi:execute first.
  3. Read brief.md, rubric.json, tasks/*.json, research/consensus-matrix.md from the active state root. On the first state write of this phase, set state.json.orchestrator.last_command_cli = "claude" with orchestrator.updated_at = current ISO-8601 time.
  4. Read all evaluations from evaluations/.

Phase B — Full Verification Suite

  1. Run the complete local verification suite the project supports.
  2. Run per-task verification: iterate each task's verification array and record results.
  3. If rubric.json.criteria.visual_design.applicable is true, gather browser-backed UI evidence before final scoring:
    • prefer a Bash-runnable capture path: the project's existing UI/e2e test harness, or npx playwright / playwright test rendering desktop and mobile widths. If a Browser or Chrome DevTools tool is available in this session, you may use it instead.
    • check console errors, obvious layout overlap, responsive behavior, and the selected direction in research/ui-layout-decision.md
    • record screenshot or test-artifact paths If no screenshot path can be produced, mark visual verification blocked; do not let the final visual_design score pass on prose alone.
  4. Write suite results to evaluations/suite-results.json.

Phase C — Final Evaluation with External Critics

  1. Read research_policy.providers from rubric.json. For each provider, spawn the matching reviewer for a final independent read of the full build:

    • codex → spawn codex-reviewer, save to reviews/codex-final.json
    • gemini → spawn gemini-reviewer, save to reviews/gemini-final.json

    When both providers are active, spawn them in parallel. If the list is empty, skip this step.

    If a selected CLI is not available, check execution_policy from rubric.json. If codex_policy is skip, proceed without that provider's review. If required, halt and warn the user. If optional, apply degraded_mode: warn_and_continue — note the absence in the scorecard and proceed; block — halt and warn the user. The same policy applies to Gemini in this phase.

  2. Spawn evaluator (foreground) with:

    • the brief, rubric, full build (not just last repair)
    • per-task verification arrays and consensus matrix
    • suite results and the review output from every active provider
    • all prior evaluations for context
    • for UI work, research/ui-layout-decision.md and screenshot/test artifact paths from the suite
  3. Write final evaluation to evaluations/review.json.

Phase D — Scorecard and Learnings

  1. Present the full scorecard:
    • Global rubric scores (functionality, code_quality, product_depth, visual_design if applicable)
    • Per-task verification results (task_id, checks passed/failed)
    • Consensus matrix cross-reference: flag any implementation that contradicts resolved planning decisions
    • Full-suite test results
    • Known gaps
    • Repair passes used during execute
    • Which external providers were consulted (Codex, Gemini, both, or none) and where any of them changed the outcome
    • Which builder ran (claude or codex, from execution_policy.primary_executor)
    • For UI work, screenshot/test artifact paths and whether the chosen layout direction was followed
  2. If the build still misses the bar:
    • Update state.json: phase -> "execute" (not "done")
    • Present the focused repair plan to the user
    • Do NOT write LEARNINGS.md or mark done — the workflow returns to /pi:execute for another repair cycle
  3. If the build passes:
    • Append durable project-specific learnings to LEARNINGS.md
    • Update state.json: phase -> "done"

Review is complete when evaluations/suite-results.json and evaluations/review.json exist, every task verification has a pass/fail/blocked state, external-review skips are policy-labeled, and state.json is either returned to "execute" for repair or advanced to "done".

Follow the protocol exactly. Present the full scorecard, test results, and any remaining repair guidance to the human.

Install via CLI
npx skills add https://github.com/abpai/skills --skill review
Repository Details
star Stars 0
call_split Forks 0
navigation Branch main
article Path SKILL.md
More from Creator