crawlab
by crawlab-team
GoDistributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
Stars
⭐ 12,132
Forks
🔱 1,890
Open Issues
📋 160
Topics
#crawlab#crawler#crawling-tasks#docker#go#platform#scrapy#scrapyd-ui#spider#spiders-management#web-crawler#webcrawler#webspider
Details
License
BSD 3-Clause "New" or "Revised" License
Created
February 10, 2019
Last Updated
January 22, 2026
Owner Type
Organization
Related Projects
traefik
The Cloud Native Application Proxy
⭐61,197
memos
An open-source, self-hosted note-taking service. Your thoughts, your data, your control — no tracking, no ads, no subscription fees.
⭐55,273
gogs
Gogs is a painless self-hosted Git service
⭐47,499
harness
Harness Open Source is an end-to-end developer platform with Source Control Management, CI/CD Pipelines, Hosted Developer Environments, and Artifact Registries.
⭐33,835
glance
A self-hosted dashboard that puts all your feeds in one place
⭐31,343
semaphore
Modern UI and powerful API for Ansible, Terraform/OpenTofu/Terragrunt, PowerShell and other DevOps tools.
⭐13,106