kurt

name: kurt version: 1.0.0 description: Content fetching, URL discovery, and workflow automation author: boringdata repository: https://github.com/boringdata/kurt-core

type: cli command: kurt

actions:

• name: fetch description: Fetch content from a URL using the best available provider usage: kurt fetch [--provider ] [--timeout ] examples:

  • kurt fetch https://example.com
  • kurt fetch https://notion.so/page --provider notion
  • kurt fetch https://docs.example.com --timeout 60

• name: map description: Discover URLs from a source (sitemap, RSS, folder) usage: kurt map [--provider ] [--max-urls ] examples:

  • kurt map https://example.com/sitemap.xml
  • kurt map https://blog.example.com/feed.xml --provider rss
  • kurt map ./docs --provider folder

• name: workflow description: Run a predefined workflow usage: kurt workflow run <workflow.toml> [--background] examples:

  • kurt workflow run sync-docs.toml
  • kurt workflow run scrape-all.toml --background

• name: tool description: Manage tools and providers usage: kurt tool examples:

  • kurt tool list
  • kurt tool info fetch
  • kurt tool providers fetch
  • kurt tool check fetch

requires:

• command: kurt install: pip install kurt
• env: ANTHROPIC_API_KEY optional: true description: Required for LLM tools

url_patterns:

• "notion.so/*"
• ".notion.site/"
• "*/sitemap.xml"
• "/sitemap.xml"
• "*/feed.xml"
• "*/rss.xml"
• "twitter.com/*"
• "x.com/*"
• "linkedin.com/*"
• "threads.net/*"
• ".substack.com/"

capabilities: - web_fetch - file_read - workflow_automation

Kurt

Kurt is a content fetching and workflow automation tool designed for AI agents.

Quick Start

# Fetch a web page
kurt fetch https://example.com

# Discover URLs from sitemap
kurt map https://example.com/sitemap.xml

# List available tools and providers
kurt tool list

Automatic Provider Selection

Kurt automatically selects the best provider based on URL patterns:

Available Tools

fetch - Retrieve content from URLs

kurt fetch https://example.com                     # Auto-select provider
kurt fetch https://example.com --provider httpx     # Specific provider
kurt fetch https://example.com --json               # JSON output

map - Discover URLs from sources

kurt map https://example.com/sitemap.xml            # From sitemap
kurt map https://blog.example.com/feed.xml          # From RSS feed
kurt map ./docs --provider folder                    # From local folder
kurt map https://example.com --provider crawl        # Web crawl

workflow - Run automation workflows

kurt workflow list                                   # List workflows
kurt workflow run sync-docs.toml                     # Run workflow
kurt workflow run scrape-all.toml --background       # Background run

tool - Manage tools and providers

kurt tool list                                       # List all tools
kurt tool info fetch                                 # Tool details
kurt tool providers fetch                            # List providers
kurt tool check                                      # Check env requirements

Configuration

Kurt reads configuration from (highest to lowest priority):

1. CLI arguments
2. Project kurt.toml
3. User ~/.kurt/config.toml
4. Provider defaults

Example kurt.toml

[tool.fetch]
provider = "trafilatura"
timeout = 30

[tool.fetch.providers.notion]
include_children = true
max_depth = 3