Open-source startups in AI infrastructure
Serving, inference, training, gateways and evaluation — the layer underneath every AI product.
Ship status
26 of 31 pushed in the last 30 days.
Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference server. | Developersalt to ChatGPT | 57.6K | Still shipping | ||
Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting. | Developersalt to ChatGPT | 52.3K | Still shipping | ||
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. | Developersalt to ChatGPT | 50.5K | Still shipping | ||
Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds. | Business teams | 46.4K | Still shipping | ||
The unified workspace where open-source models get things done for you. | Data teams | 39.9K | Still shipping | ||
🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud. | Developers | 37.7K | Still shipping | ||
LLM API 管理 & 分发系统,支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型,统一 API 适配,可用于 key 管理与二次分发。单可执行文件,提供 Docker 镜像,一键部署,开箱即用。LLM API management & key redistribution system, unifying multiple providers under a single API. Single binary, Docker-ready, with an English UI. | Developers | 37.5K | Gone silent | ||
Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation. | Data teams | 32.7K | Still shipping | ||
Label Studio is a multi-type data labeling and annotation tool with standardized output format | Data teams | 28.7K | Still shipping | ||
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar | Developers | 23.8K | Still shipping | ||
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. | Data teams | 23.5K | Still shipping | ||
Kortix CompanyOS – the open-source operating system for your company. Multiplayer AI agents, your company as code, sovereign on your infrastructure or ours. | Data teams | 20.8K | Still shipping | ||
Experiential is the open source, zero markup gateway for BYOK, self-hosted and 1000+ marketplace models. It learns from your traffic to cut costs, recommend better models, and train a specialized model you own. | Developers | 18.1K | Still shipping | ||
Free and Open Source Machine Translation API. Self-hosted, offline capable and easy to setup. | Developers | 17.8K | Still shipping | ||
Memori is agent-native memory infrastructure. A LLM-agnostic layer that turns agent execution and conversation into structured, persistent state for production systems. Built for enterprise, Memori works with the data infrastructure you already run, no rip-and-replace, and deploys across managed cloud, single-tenant cloud, VPC, and on-premises. | Developers | 17.6K | Slowed | ||
CVAT is a leading data annotation platform for image, video, audio, and 3D datasets. It offers open-source, cloud, and enterprise products, as well as labeling services, with AI-assisted labeling, quality assurance, team collaboration, analytics, and developer APIs. | Data teams | 17.2K | Still shipping | ||
Graph-Native Semantic Layer for Trustworthy Enterprise AI | Developers | 14.7K | Still shipping | ||
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. | Developers | 13.4K | Still shipping | ||
CRS-自建Claude Code镜像,一站式开源中转服务,让 Claude、OpenAI、Gemini、Droid 订阅统一接入,支持拼车共享,更高效分摊成本,原生工具无缝使用。 | Developersalt to ChatGPT | 12.8K | Still shipping | ||
BISHENG is an open-source enterprise Agent platform for building, deploying, and managing AI applications. It combines AI agents, workflows, RAG and knowledge management, desktop agent integration, and vibecoding app hosting with unified model management, evaluation, observability, access control, and enterprise administration. | Developers | 12.4K | Still shipping | ||
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation. | Data teams | 11.7K | Gone silent | ||
The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production. | Data teams | 11.3K | Still shipping | ||
Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol) | Developers | 10.9K | Still shipping | ||
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster. | Data teams | 10.9K | Still shipping | ||
Open source annotation tool for machine learning practitioners. | Data teams | 10.8K | Gone silent | ||
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS. | Developers | 9.8K | Still shipping | ||
🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache. | Developers | 9.3K | Gone silent | ||
Self-hosted control plane for AI agents: dispatch tasks, review runs, track spend, and operate OpenClaw, Claude Code, Codex, and other runtimes. | Developers | 6.5K | Still shipping | ||
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances. | IT and operations | 6.1K | Still shipping | ||
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more. | Data teams | 5.3K | Still shipping | ||
Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company. | Developers | 5K | Still shipping |
How projects are grouped
Jev assigns one category from the repository name, description and homepage. Activity uses the last push to any branch.