braintrust

name: braintrust description: Runtime-agnostic adapter for the shared Braintrust prompt CLI. Use for prompt listing, retrieval, invoke/testing, diff/update, and promotion. argument-hint: [options] allowed-tools: Bash(python3 /bt_cli.py )

Braintrust Prompt Management

This skill is a runtime-agnostic adapter for the shared CLI engine at skills/braintrust/bt_cli.py.

Codex/shell command: ./braintrust <command>
Claude runtime command: /braintrust <command>

Both call the same core engine.

Canonical Commands

Command	Description	Side Effects
`list`	List prompts	None
`get --slug X`	View prompt details	None
`invoke --slug X --input '{...}'`	Run prompt with tracing	Creates trace
`diff --slug X --system "..."`	Preview message changes	None
`update --slug X --system "..."`	Apply message changes	Modifies prompt
`test --slug X --input '{...}' [--system "..."]`	Simple run or A/B test	May create/promote/delete v2
`promote --from X --to Y`	Copy X content into Y	Modifies Y

Extended commands: create, delete, generate.

Usage

./braintrust list
./braintrust get --slug "my-prompt"
./braintrust invoke --slug "my-prompt" --input '{"question":"test"}'
./braintrust diff --slug "my-prompt" --system "New content"
./braintrust update --slug "my-prompt" --system "New content"
./braintrust test --slug "my-prompt" --input '{"q":"test"}' --system "New instructions" --force
./braintrust promote --from "my-prompt-v2" --to "my-prompt" --force

Non-Interactive Mode

Commands with confirmation prompts (test in A/B mode, promote, delete) support --force (-y). Use --force for automation and Claude Code execution.

Environment

BRAINTRUST_API_KEY=sk-your-api-key        # Required
BRAINTRUST_PROJECT_NAME=Your_Project_Name # Optional default project

The braintrust Python SDK is required for invoke and test:

pip install braintrust

Key Rules

Always run diff before update.
Use --force in non-interactive/automated workflows.
Use A/B test mode for significant prompt changes.
Keep prompt slugs explicit and versioned (my-prompt-v2).

Reference

See reference.md for detailed examples and command options.

name: braintrust description: Runtime-agnostic adapter for the shared Braintrust prompt CLI. Use for prompt listing, retrieval, invoke/testing, diff/update, and promotion. argument-hint: [options] allowed-tools: Bash(python3 */bt_cli.py *)