By name: run-e2e description: Run the toolbox-web Playwright e2e suites — docs-demo tests, cross-framework parity tests, performance-regression and stability tests. Covers starting demo servers, the various run commands, and updating visual baselines.
Run E2E Suites
Two Playwright e2e suites exist. This skill is the runbook — how to execute them and manage servers/baselines. For how to write e2e tests (conventions, utilities, selectors, wait strategies), see the auto-applied e2e-testing instruction.
| Suite | Location | Purpose | Server |
|---|---|---|---|
| Docs demos | apps/docs-e2e/ |
Every Astro demo page renders and works correctly | Auto-starts Astro on port 4450 |
| Cross-framework | e2e/ |
Visual/functional parity across Vanilla, React, Angular, Vue demos | Manual server start required |
Docs demo tests
Auto-starts the Astro dev server — no manual setup:
bun nx e2e docs-e2e
Cross-framework tests
Demo servers must be running first (these tests do not auto-start servers).
# Option 1: start the 4 demo servers in a separate terminal, then run tests
bun run demo # vanilla=4000, react=4300, angular=4200, vue=4100
bun nx e2e e2e # run tests against the running servers
# Option 2: build + start dist servers + wait for ports + test (CI-friendly)
bun run e2e:full
If a run fails with connection-refused / timeout on ports 4000/4100/4200/4300, the demo servers aren't up — start them (Option 1) or use e2e:full (Option 2).
Update visual baselines
Only after intentionally changing rendered output. Review the regenerated PNGs before committing.
bun nx e2e:update-snapshots e2e
Performance-regression tests
Part of the regular e2e suite. Compares the current build against the latest published release (loaded from CDN) in the same browser session, so runner variance cancels out. Flags a regression if the current build is >10% slower; auto-retries up to 2× to absorb CI noise.
# Requires a build first (for the local UMD bundle)
bun nx build grid
# Run the self-comparison tests (no demo server needed)
bunx playwright test --config=e2e/playwright.config.ts performance-regression
| Env var | Purpose |
|---|---|
PERF_CDN_VERSION |
Override CDN version to compare against (default: latest) |
PERF_RUN_ID |
Unique ID for the output file (perf-metrics-{runId}.json) |
Grid-stability tests
Structural assertions against the vanilla demo (virtualization bounds, zero JS errors, no memory/DOM leaks). Fast, deterministic, part of the regular e2e suite — no separate command needed.
| File | Purpose |
|---|---|
e2e/tests/performance-regression.spec.ts |
Self-comparison benchmarks (no demo needed) |
e2e/tests/grid-stability.spec.ts |
Structural stability tests (vanilla demo) |
e2e/tests/perf-metrics-helper.ts |
Metric accumulator + flush utility |