Category
Open-source startups in Data engineering
Pipelines, orchestration and integration — the plumbing that moves data from where it lands to where it is used. 6 open-source startups in this directory are filed under Data engineering. 4 pushed code in the last 30 days, 0 have been quiet for 31–120 days, 2 have not pushed in over 120 days or are archived. The category is chosen by Jev, TypeSafe’s classifier, reading only the repository’s own name, description and homepage — one category per project, so something that spans two appears under whichever the classifier judged closest.
Ship status
4 of 6 pushed in the last 30 days.
The list
All 6, most-starred first.
The last column is the most recent push to any branch, by a person or a bot — it is not a claim that anyone is maintaining the project, and a quiet repository may be a finished one. The “built for” column and the “alternative to” chips are Jev’s answers about the same repository description, published with the rest of them.
| Project | What it does | Built for | Stars | Ship status | Last push |
|---|---|---|---|---|---|
 firecrawlfirecrawl/firecrawlStill shipping | Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥 | Developers | 190.5K | Still shipping | |
 airbyteairbytehq/airbyteStill shipping | Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud. | Data teamsalt to Fivetran | 22.2K | Still shipping | |
 pyspiderbinux/pyspiderGone silent | A Powerful Spider(Web Crawler) System in Python. | Developers | 16.8K | Gone silent | |
 dagsterdagster-io/dagsterStill shipping | An orchestration platform for the development, production, and observation of data assets. | Data teams | 16.3K | Still shipping | |
 datahubdatahub-project/datahubStill shipping | The Context Platform for your Data and AI Stack | Data teams | 12.8K | Still shipping | |
 crawlabcrawlab-team/crawlabGone silent | Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架 | Developers | 12.3K | Gone silent |
Related collections
Sideways from here.
The 8 largest other categories in the directory, then the other ways to slice it.