scrape-and-load - SKILL.md Agent Skill

name: scrape-and-load description: Run the Wookieepedia scraper, convert data, load into SQLite, and verify with migration and full tests. disable-model-invocation: true

Run the full data pipeline sequentially from the cap/ directory.

Scrape Star Wars data
```
cd cap && npm run scrape
```
Uses committed cache by default (fast). If the user requests --bypass-cache, ask for explicit confirmation first, then run npm run scrape:bypass-cache instead.
Build CDS artifacts
```
cd cap && npm run build
```
Load fixture data into SQLite
```
cd cap && npm run load_sqlite
```
Run migration tests
```
cd cap && npm run test:migration
```
Verifies data conversion logic and report generation.
Run full test suite
```
cd cap && npm test
```

Stop on failure. If any step fails, report the error and do not continue.
Cache-first by default. Never bypass the scraper cache without user confirmation — fresh fetches hit Wookieepedia and take significantly longer.
Report results. Summarize each step's outcome: scrape stats, build status, load counts, and test pass/fail/skip.