create-eval

star 527

Redirect to the inspect-evals-template for creating new evaluations. New evals are no longer created in this repository — they live in standalone repos. Use when user asks to create/implement/build a new evaluation.

UKGovernmentBEIS By UKGovernmentBEIS schedule Updated 5/4/2026

name: create-eval description: Redirect to the inspect-evals-template for creating new evaluations. New evals are no longer created in this repository — they live in standalone repos. Use when user asks to create/implement/build a new evaluation.

Create Evaluation

New evaluations are no longer created in the inspect_evals repository. Since May 2026, evaluations live in their own standalone repositories. This repo now serves as a register that points to upstream eval repos.

This skill has been moved to inspect-evals-template: https://github.com/Generality-Labs/inspect-evals-template/tree/main/.claude/skills/create-eval. If a user triggers this skill, inform them to go to the template to run or access the skill there.

If a user asks to create an eval, inform them that Inspect Evals no longer accepts code submissions for new evals and suggest the inspect-evals-template for guidance on creating evals.

Quick reference

Step Where
Create a new eval inspect-evals-template
Register a completed eval This repo — use the Prepare Evaluation For Submission skill
Install via CLI
npx skills add https://github.com/UKGovernmentBEIS/inspect_evals --skill create-eval
Repository Details
star Stars 527
call_split Forks 349
navigation Branch main
article Path SKILL.md
More from Creator
UKGovernmentBEIS
UKGovernmentBEIS Explore all skills →