cost-report

star 25

Token and cost analysis per run, suite, and config. Shows most expensive tasks and config cost comparison. Triggers on cost report, how much did it cost, token usage, spending.

sourcegraph By sourcegraph schedule Updated 3/17/2026

name: cost-report description: Token and cost analysis per run, suite, and config. Shows most expensive tasks and config cost comparison. Triggers on cost report, how much did it cost, token usage, spending. user-invocable: true

Cost Report

Analyze token usage and estimated cost across benchmark runs.

Steps

1. Run cost analysis

cd ~/CodeScaleBench && python3 scripts/cost_report.py

2. Present findings

The table output shows:

  • Total cost, tokens, and wall-clock hours
  • Per suite/config breakdown with average cost per task
  • Config cost comparison (is SG_full significantly more expensive than baseline?)
  • Top 10 most expensive individual tasks

Variants

Filter to one suite

python3 scripts/cost_report.py --suite csb_sdlc_pytorch

Filter to one config

python3 scripts/cost_report.py --config sourcegraph_full

JSON output

python3 scripts/cost_report.py --format json
Install via CLI
npx skills add https://github.com/sourcegraph/CodeScaleBench --skill cost-report
Repository Details
star Stars 25
call_split Forks 3
navigation Branch main
article Path SKILL.md
More from Creator