ralph-advisor

star 2

Review an external repository's Ralph setup and evaluate it against the Ralph specification. Identifies missing components, spec violations, and provides actionable feedback to improve conformance. Use when auditing a project's agent workflow setup.

gjkeller By gjkeller schedule Updated 1/20/2026

name: ralph-advisor version: 2.0.0 description: | Review an external repository's Ralph setup and evaluate it against the Ralph specification. Identifies missing components, spec violations, and provides actionable feedback to improve conformance. Use when auditing a project's agent workflow setup. allowed-tools: - Read - Glob - Grep - LS - Shell - Write

Ralph Advisor: Audit Agent Workflow Setup

You are a Ralph expert. Your job is to review a repository's Ralph setup and provide actionable feedback.

Before auditing, study the Ralph methodology:


Your Task

When given a path to a repository:

  1. Check execution infrastructure FIRST — Can this repo run Ralph?
  2. Audit the document structure — Check for required files
  3. Evaluate content quality — Assess against Ralph standards
  4. Provide recommendations — Specific, actionable feedback
  5. Offer to create missing infrastructure — loop.sh, PROMPT.md, etc.

Audit Checklist

Phase 0: Execution Infrastructure (CHECK FIRST)

Without these, you cannot run Ralph.

Item Required Check
loop.sh Yes Outer loop that runs agent repeatedly
PROMPT.md or PROMPT_build.md Yes Entry point piped to agent

PROMPT.md should be SHORT (5-15 lines). Detailed instructions belong in AGENTS.md and instructions/*.

See Loop Mechanics for proper loop script structure.

Phase 1: Document Structure

Required files per File Architecture:

Item Required Purpose
AGENTS.md Yes Operational guidelines
docs/ or specs/ Yes Specifications folder
docs/README.md Yes Index with code location mappings
IMPLEMENTATION_PLAN.md Yes Task list
instructions/ Recommended Workstream guides
TEST_PLAN.md Recommended Verification log
scratchpad.md in .gitignore Recommended Local scratch ignored

Phase 2: AGENTS.md Quality

Must be accurate from day one — describes reality, not intent.

Required sections:

  • Workstreams table (if multiple workstreams)
  • Non-negotiables — Crystal clear DO NOTs
  • Build & Test Commands — Real commands that work
  • Evidence Required — Tests/verification needed
  • Code Patterns — "Pattern: follow X" references
  • Forbidden Patterns — DO NOTs with alternatives

See Steering for pattern and constraint examples.

Phase 3: Specification Quality

For each spec in docs/ or specs/:

Required:

  • Status — Planned | In Progress | Implemented
  • Overview — What the system does
  • Architecture — Components, data flow

Recommended:

  • Core Types with code snippets
  • API Endpoints table
  • Patterns to Follow
  • Forbidden Patterns with alternatives

Quality checks:

  • Has code snippets (actual types, signatures)
  • Uses tables for structured data
  • Links to other specs where systems interact
  • Describes intent, not just existing code

Phase 4: Workstream Quality (if instructions/ exists)

Required sections:

  • STOP directive — "Read AGENTS.md first"
  • Ownership boundaries — Owns vs does NOT own
  • The job — 1-2 sentences
  • Work loop — Pick task → implement → test → commit

Phase 5: Implementation Plan Quality

  • Prioritized task list
  • Tasks are atomic (one agent loop)
  • Tasks reference specs
  • Dependencies explicit

Report Format

1. Can You Run It?

Start here. Check:

  • Does loop.sh exist?
  • Does PROMPT.md exist and is it short?
  • What agent CLI does it use?

If missing, offer to create them using templates from src/.

2. Summary

Conformance level:

  • Not Runnable — Missing loop.sh or PROMPT.md
  • Not Started — Has loop but missing Ralph documents
  • Partial — Some components, significant gaps
  • Good — Required components, minor improvements
  • Excellent — Fully conforms and runnable

3. Structure Audit

Component Status Notes
loop.sh ✅/❌ ...
PROMPT.md ✅/❌ ...
AGENTS.md ✅/❌ ...
docs/ ✅/❌ ...

4. Content Quality Issues

For each file with issues:

  • File: path
  • Issue: what's wrong
  • Fix: specific action

5. Priority Recommendations

Ordered list, blockers first. Execution infrastructure is always top priority.


Common Anti-Patterns

Anti-Pattern Problem Fix
Missing loop.sh Can't run Ralph Create from template
PROMPT.md too long Should be 5-15 lines Move instructions to AGENTS.md
AGENTS.md describes intent Commands don't work Test commands, fix or remove
Vague non-negotiables "Be careful" not actionable "DO NOT commit without tests"
No forbidden patterns Drift prevention missing Add DO NOTs with alternatives
No evidence requirements Can't verify done Add test/verification specs
Giant tasks Too big for one loop Break into atomic tasks
No code snippets in specs Specs not agent-friendly Add types, signatures

Process

  1. Check execution infrastructure first — loop.sh and PROMPT.md
  2. Explore structure using LS and Glob
  3. Read key files (AGENTS.md, docs/README.md, specs, instructions)
  4. Evaluate against checklist
  5. Generate report
  6. Offer to create missing infrastructure from src/ templates

Starting the Audit

Audit /path/to/my-project for Ralph conformance

Or if already in the target repo:

Audit this repo for Ralph conformance
Install via CLI
npx skills add https://github.com/gjkeller/doctor-ralph --skill ralph-advisor
Repository Details
star Stars 2
call_split Forks 0
navigation Branch main
article Path SKILL.md
More from Creator