web-scraping-ethics-guide
Scrape web data ethically and legally for research purposes
Profile →npx skills add brycewang-stanford/Auto-Empirical-Research-Skills --skill web-scraping-ethics-guide --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Ethical Web Scraping for Research A skill for collecting web data ethically and legally for research purposes. Covers robots.txt compliance, rate limiting, legal frameworks, data privacy considerations, and practical scraping techniques that respect website operators and comply with institutional review requirements. ## Ethical Framework ### Principles of Ethical Scraping ``` 1. Respect robots.t
What does the web-scraping-ethics-guide skill do?
Scrape web data ethically and legally for research purposes
How do I install it?
Run `npx skills add brycewang-stanford/Auto-Empirical-Research-Skills --skill web-scraping-ethics-guide --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From brycewang-stanford/Auto-Empirical-Research-Skills, a repository with 3,244 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.