harvest-single

star 506

Single page smart extraction - articles, docs, blog posts to clean markdown

vibeeval By vibeeval schedule Updated 3/25/2026

name: harvest-single description: Single page smart extraction - articles, docs, blog posts to clean markdown allowed-tools: [Bash, Read, Write, WebFetch] keywords: [harvest, scrape, extract, single, page, article, documentation, markdown]

Harvest Single Page

Extract and clean content from a single web page. Auto-detects content type (article, documentation, API reference, blog post) and produces clean, structured markdown.

Usage

/harvest <url>

Examples

# Extract a blog post
/harvest https://blog.example.com/best-practices-2024

# Extract API documentation page
/harvest https://docs.stripe.com/api/charges

# Extract a GitHub README
/harvest https://github.com/owner/repo

How It Works

  1. Fetch URL content via WebFetch or crawl4ai
  2. Detect content type (article, docs, API ref, blog, wiki)
  3. Extract main content, strip navigation/ads/footers
  4. Preserve code blocks, tables, images
  5. Add metadata header (source, date, word count)
  6. Save to .claude/cache/agents/harvest/

Output Format

# [Page Title]
> Source: [URL]
> Extracted: [timestamp]
> Type: [article|docs|api|blog|wiki]
> Words: [count]

[Clean extracted content in markdown]

## Links Found
- [Link text](URL)

Fallback Chain

  1. crawl4ai Docker (port 11235) - preferred
  2. WebFetch tool - built-in fallback
  3. curl + html2text - last resort

When to Use

  • Quick grab of a single page's content
  • Extracting a specific doc page for reference
  • Saving an article for later analysis
  • Getting clean markdown from messy HTML
Install via CLI
npx skills add https://github.com/vibeeval/vibecosystem --skill harvest-single
Repository Details
star Stars 506
call_split Forks 42
navigation Branch main
article Path SKILL.md
More from Creator