crawlab
by crawlab-team
GoDistributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
Stars
⭐ 11,914
Forks
🔱 1,859
Open Issues
📋 152
Topics
#crawlab#crawler#crawling-tasks#docker#go#platform#scrapy#scrapyd-ui#spider#spiders-management#web-crawler#webcrawler#webspider
Details
License
BSD 3-Clause "New" or "Revised" License
Created
February 10, 2019
Last Updated
September 14, 2025
Owner Type
Organization
Related Projects
traefik
The Cloud Native Application Proxy
⭐56,654
gogs
Gogs is a painless self-hosted Git service
⭐46,907
memos
A modern, open-source, self-hosted knowledge management and note-taking platform designed for privacy-conscious users and organizations.
⭐44,262
harness
Harness Open Source is an end-to-end developer platform with Source Control Management, CI/CD Pipelines, Hosted Developer Environments, and Artifact Registries.
⭐33,236
glance
A self-hosted dashboard that puts all your feeds in one place
⭐27,920
semaphore
Modern UI and powerful API for Ansible, Terraform/OpenTofu/Terragrunt, PowerShell and other DevOps tools.
⭐12,503