revyl-mcp-analyze

star 448

Analyze failed Revyl MCP test executions and classify them as real bugs, flaky tests, infra issues, or test-design improvements.

RevylAI By RevylAI schedule Updated 2/20/2026
play_arrow Run Skill in Manus View GitHub

name: revyl-mcp-analyze description: Analyze failed Revyl MCP test executions and classify them as real bugs, flaky tests, infra issues, or test-design improvements.

Revyl MCP Analyze Skill

Evidence Flow

  1. Start from task ID after run_test.
  2. Pull status payload:
    • get_test_status(task_id="...")
  3. Inspect failed step expectations and observed reasoning.
  4. Classify:
    • REAL BUG
    • FLAKY TEST
    • INFRA ISSUE
    • TEST IMPROVEMENT
  5. Recommend exact next tool/action.

Classification Rules

  • REAL BUG: actions complete but app behavior contradicts expected outcome.
  • FLAKY TEST: app behavior is acceptable but validation is too brittle.
  • INFRA ISSUE: no meaningful app steps executed or setup/device/build failure.
  • TEST IMPROVEMENT: test structure is weak or allows ambiguity.

Required Output

Task: <task-id>
Classification: <REAL BUG | FLAKY TEST | INFRA ISSUE | TEST IMPROVEMENT>
Confidence: <HIGH | MEDIUM | LOW>
Evidence:
- Expected: <summary>
- Observed: <summary>
- Why: <short rationale>
Next action:
- <specific update_test / rerun / bug filing action>
Install via CLI
npx skills add https://github.com/RevylAI/revyl-cli --skill revyl-mcp-analyze
Repository Details
star Stars 448
call_split Forks 19
navigation Branch main
article Path SKILL.md
More from Creator
RevylAI
RevylAI Explore all skills →