Open-source startups tagged #crawler

Ship status

5still shipping
0slowed
3gone silent

5 of 8 pushed in the last 30 days.

8 projects
firecrawlfirecrawl/firecrawlStill shipping

Knowledge infrastructure to make your agents smarter. Search, scrape and 550+ data providers through one API.

204.4KStill shipping
crawl4aiunclecode/crawl4aiStill shipping

Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.

87.6KStill shipping
EasySpiderNaiboWang/EasySpiderStill shipping

A visual no-code/code-free web crawler/spider易采集:一个可视化浏览器自动化测试/数据采集/网页爬虫软件,可以无代码图形化的设计和执行爬虫任务。别名:ServiceWrapper面向Web应用的智能化服务封装系统。

44.8KStill shipping
maxungetmaxun/maxunStill shipping

Turn any website into a structured API. Extract, automate, search and monitor the web.

18.5KStill shipping
pyspiderbinux/pyspiderGone silent

A Powerful Spider(Web Crawler) System in Python.

16.7KGone silent
crawlabcrawlab-team/crawlabGone silent

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架

12.3KGone silent
spider-flowssssssss-team/spider-flowGone silent

新一代爬虫平台,以图形化方式定义爬虫流程,不写代码即可完成爬虫。

11.4KGone silent
xiaobeiTeamWiseFlow/xiaobeiStill shipping

为OPC/中小微企业量身打造的自媒体获客智能体

8.7KStill shipping
How projects are grouped

Repository maintainers choose their own GitHub topics. A project can appear under several. Activity uses the last push to any branch.