web-scraping

star 254

Web scraping and data extraction best practices

mindspore-ai By mindspore-ai schedule Updated 2/10/2026
play_arrow Run Skill in Manus View GitHub

name: web-scraping description: "Web scraping and data extraction best practices" category: utility license: MIT compatibility: claude-code

Web Scraping Skill

Overview

This skill provides guidance on web scraping using modern tools.

Tools

  • Beautiful Soup for HTML parsing
  • Selenium for dynamic content
  • Scrapy for large-scale scraping

Best Practices

  1. Respect robots.txt
  2. Use rate limiting
  3. Handle errors gracefully
Install via CLI
npx skills add https://github.com/mindspore-ai/akg --skill web-scraping
Repository Details
star Stars 254
call_split Forks 48
navigation Branch main
article Path SKILL.md
More from Creator
mindspore-ai
mindspore-ai Explore all skills →