scraper

Create agents that monitor and act on your behalf. Your agents are standing by!

The fast, flexible, and elegant library for parsing and manipulating HTML and XML.

👾 Fast and simple video download library and CLI tool written in Go

Elegant Scraper and Crawler Framework for Golang

A visual no-code/code-free web crawler/spider易采集：一个可视化爬虫软件，可以无代码图形化的设计和执行爬虫任务

News, full-text, and article metadata extraction in Python 3. Advanced docs:

📙 中华新华字典数据库。包括歇后语，成语，词语，汉字。

AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database

Crawlee—A web scraping and browser automation library for Node.js that helps you build reliable crawlers. Fast.

A collection of awesome web crawler,spider in different languages

Declarative web scraping

Distributed crawler powered by Headless Chrome

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

A community-driven way to read and chat with AI bots - powered by chatGPT.

🔮 A Node.js scraper for humans.

A Devtools driver for web automation and scraping

An Android Anilist client, which lets you stream & download Anime & Manga.

YouTube video downloader in javascript.

A social networking service scraper in Python

Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?