test-acp-agents

name: test-acp-agents description: Tests the ACP Swift SDK against multiple ACP agents (qwen, gemini, claude-code-acp) to verify compatibility.

Test ACP Agents Skill

Tests the ACP Swift SDK against multiple ACP agents to verify compatibility.

Trigger

User says: "/test-agents" or "test acp agents" or "run agent tests"

Agents to Test

Test each of these agents in order:

1. qwen --experimental-acp - Qwen Code
2. gemini --experimental-acp - Gemini CLI
3. npx @zed-industries/claude-code-acp - Claude Code ACP

Process

1. For each agent: a. Update Examples/BasicUsage/Sources/BasicUsage/main.swift to set AgentConfig.command to the agent command b. Run swift run in the Examples/BasicUsage directory c. Verify the output shows:

   • "Connected!"
   • "Session created:"
   • "Prompt completed with stop reason: endTurn"
   • "Done!" d. Record pass/fail status

2. After testing all agents, run swift test in the SDK root to verify all unit tests pass

3. Report results in a summary table:

   | Agent | Command | Result |
   |-------|---------|--------|
   | Qwen | qwen --experimental-acp | Pass / Fail |
   | Gemini | gemini --experimental-acp | Pass / Fail |
   | Claude Code | npx @zed-industries/claude-code-acp | Pass / Fail |
   
   Unit Tests: X tests passed
   

Timeout

Each agent test should have a 2-minute timeout. If an agent hangs, kill it and mark as failed.

Error Handling

If an agent fails:

• Capture the error message
• Note which step failed (connection, session creation, prompt, etc.)
• Continue testing remaining agents
• Include error details in the final report

Example Output

Testing ACP agents...

[1/3] Testing qwen --experimental-acp
Connected to qwen-code v0.8.2
Session created
Prompt completed
Result: PASS

[2/3] Testing gemini --experimental-acp
Connected to agent
Session created
Prompt completed
Result: PASS

[3/3] Testing npx @zed-industries/claude-code-acp
Connected to @zed-industries/claude-code-acp v0.13.2
Session created
Prompt completed
Result: PASS

Running unit tests...
61 tests passed

Summary:
| Agent | Command | Result |
|-------|---------|--------|
| Qwen | qwen --experimental-acp | Pass |
| Gemini | gemini --experimental-acp | Pass |
| Claude Code | npx @zed-industries/claude-code-acp | Pass |

All agents compatible!