Trending AI repositories

firecrawl/

firecrawl

The API to search, scrape, and interact with the web at scale. 🔥

D4Vinci/

Scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

ScrapeGraphAI/

Scrapegraph-ai

Python scraper based on AI

jo-inc/

camofox-browser

Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.

autoscrape-labs/

pydoll

Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.

adbar/

trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

brightdata/

brightdata-mcp

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

TheGP/

untidetect-tools

List of anti-detect and humanizing tools and browsers, including captcha solvers and sms-activation.

feder-cr/

invisible_playwright

Anti-Detect Browser that passes every bot detection test. Drop-in Playwright replacement.

tiliondev/

fortress

Stealth Chromium engine that stops scrapers and browser agents from getting blocked, with one line of code change.

Ayyouboss0011/

SherlockMaps

Powerful Google Maps Crawler / Scraper tool with REST API, Docker support & multi-format export