Category
Open-source startups in Data engineering
Pipelines, orchestration and integration — the plumbing that moves data from where it lands to where it is used. 6 open-source startups in this directory are filed under Data engineering. 4 pushed code within 30 days of the snapshot of 2026-09-22, 0 have been quiet for 31–120 days, 2 have not pushed in over 120 days. The category is chosen by Jev, TypeSafe’s classifier, reading only the repository’s own name, description and homepage — one category per project, so something that spans two appears under whichever the classifier judged closest.
4 of 6 pushed within 30 days of the snapshot of 2026-09-22. How we measure it →
The list
All 6, most-starred first.
The last column is the most recent push GitHub reported to us on 2026-09-22. It counts a push to any branch, by a person or a bot — it is not a claim that anyone is maintaining the project, and a quiet repository may be a finished one. The “built for” column and the “alternative to” chips are Jev’s answers about the same repository description, published with the rest of them.
| Project | What it does | Built for | Stars | Ship status | Last verified push |
|---|---|---|---|---|---|
| firecrawl/firecrawl | The web data API to search, scrape, and interact at scale. 🔥 | Developers | 183.2K | Still shipping | Sep 22, 2026 |
| airbytehq/airbyte | Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud. | Data teamsalt to Fivetran | 22.1K | Still shipping | Sep 22, 2026 |
| binux/pyspider | A Powerful Spider(Web Crawler) System in Python. | Developers | 16.8K | Gone silent | Apr 30, 2024 |
| dagster-io/dagster | An orchestration platform for the development, production, and observation of data assets. | Data teams | 16.2K | Still shipping | Sep 22, 2026 |
| datahub-project/datahub | The Context Platform for your Data and AI Stack | Data teams | 12.7K | Still shipping | Sep 22, 2026 |
| crawlab-team/crawlab | Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架 | Developers | 12.3K | Gone silent | Feb 10, 2026 |
Related collections
Sideways from here.
The 8 largest other categories in the directory, then the other ways to slice it. Every count is as of the snapshot of 2026-09-22.
Snapshot of 2026-09-22 · 721 repos in the directory · every number on this page is measured against that date, not against today. What this measurement cannot tell you →