A next-generation crawling and spidering framework.

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

简单易用的Python爬虫框架，QQ交流群：597510560

SpiderSuite (web security crawler) releases, wiki and roadmap

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

天眼查爬虫&企查查爬虫，指定关键字爬取公司信息

微信文章爬虫，用于采集、整理和归档微信公众号公开文章元数据，欢迎一起学习讨论。A Windows research workbench for collecting, organizing, and archiving public WeChat article metadata.

ACHE is a web crawler for domain-specific search.

The simple, easy to use command line web crawler.

The unix-way web crawler

🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)

Antch, a fast, powerful and extensible web crawling & scraping framework for Go

旨在将网易云、酷狗、QQ、酷我等各音乐平台集于一体

Ignareo the Carillon, a web crawler/spider template of ultimate high concurrency built for leprechauns. Carillons as the best web spiders; Long live the golden years of leprechauns! (ISML=international saimoe; 2022 ISML is last ISML)

A simple distributed crawler for zhihu && data analysis

Web spider as a service, spider on serverless

Tool made to automate tasks of pentesting.

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

talospider - A simple,lightweight scraping micro-framework

网络爬虫模拟登陆bilibili 滑动验证码的破解 弹幕发送 2018-10-9