Open-source startups in AI infrastructure

Serving, inference, training, gateways and evaluation — the layer underneath every AI product.

Ship status

26still shipping
1slowed
4gone silent

26 of 31 pushed in the last 30 days.

31 projects
private-gptzylon-ai/private-gptStill shipping

Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference server.

Developersalt to ChatGPT57.6KStill shipping
new-apiQuantumNous/new-apiStill shipping

Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.

Developersalt to ChatGPT52.3KStill shipping
LocalAImudler/LocalAIStill shipping

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Developersalt to ChatGPT50.5KStill shipping
iFixAiifixai-ai/iFixAiStill shipping

Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

Business teams46.4KStill shipping
mindshubmindsdb/mindsdbStill shipping

The unified workspace where open-source models get things done for you.

Data teams39.9KStill shipping
langfuselangfuse/langfuseStill shipping

🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.

Developers37.7KStill shipping
one-apisongquanpeng/one-apiGone silent

LLM API 管理 & 分发系统,支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型,统一 API 适配,可用于 key 管理与二次分发。单可执行文件,提供 Docker 镜像,一键部署,开箱即用。LLM API management & key redistribution system, unifying multiple providers under a single API. Single binary, Docker-ready, with an English UI.

Developers37.5KGone silent
cuatrycua/cuaStill shipping

Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.

Data teams32.7KStill shipping
label-studioHumanSignal/label-studioStill shipping

Label Studio is a multi-type data labeling and annotation tool with standardized output format

Data teams28.7KStill shipping
omlxjundot/omlxStill shipping

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Developers23.8KStill shipping
opikcomet-ml/opikStill shipping

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Data teams23.5KStill shipping
CompanyOSkortix-ai/sunaStill shipping

Kortix CompanyOS – the open-source operating system for your company. Multiplayer AI agents, your company as code, sovereign on your infrastructure or ours.

Data teams20.8KStill shipping
experientialexperientiallabs/experientialStill shipping

Experiential is the open source, zero markup gateway for BYOK, self-hosted and 1000+ marketplace models. It learns from your traffic to cut costs, recommend better models, and train a specialized model you own.

Developers18.1KStill shipping
LibreTranslateLibreTranslate/LibreTranslateStill shipping

Free and Open Source Machine Translation API. Self-hosted, offline capable and easy to setup.

Developers17.8KStill shipping
MemoriMemoriLabs/MemoriSlowed

Memori is agent-native memory infrastructure. A LLM-agnostic layer that turns agent execution and conversation into structured, persistent state for production systems. Built for enterprise, Memori works with the data infrastructure you already run, no rip-and-replace, and deploys across managed cloud, single-tenant cloud, VPC, and on-premises.

Developers17.6KSlowed
cvatcvat-ai/cvatStill shipping

CVAT is a leading data annotation platform for image, video, audio, and 3D datasets. It offers open-source, cloud, and enterprise products, as well as labeling services, with AI-assisted labeling, quality assurance, team collaboration, analytics, and developer APIs.

Data teams17.2KStill shipping
semanticasemantica-agi/semanticaStill shipping

Graph-Native Semantic Layer for Trustworthy Enterprise AI

Developers14.7KStill shipping
gatewayPortkey-AI/gatewayStill shipping

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Developers13.4KStill shipping
claude-relay-serviceWei-Shaw/claude-relay-serviceStill shipping

CRS-自建Claude Code镜像,一站式开源中转服务,让 Claude、OpenAI、Gemini、Droid 订阅统一接入,支持拼车共享,更高效分摊成本,原生工具无缝使用。

Developersalt to ChatGPT12.8KStill shipping
bishengdataelement/bishengStill shipping

BISHENG is an open-source enterprise Agent platform for building, deploying, and managing AI applications. It combines AI agents, workflows, RAG and knowledge management, desktop agent integration, and vibecoding app hosting with unified model management, evaluation, observability, access control, and enterprise administration.

Developers12.4KStill shipping
tensorzerotensorzero/tensorzeroGone silent

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

Data teams11.7KGone silent
wandbwandb/wandbStill shipping

The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.

Data teams11.3KStill shipping
tykTykTechnologies/tykStill shipping

Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)

Developers10.9KStill shipping
skypilotskypilot-org/skypilotStill shipping

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

Data teams10.9KStill shipping
doccanodoccano/doccanoGone silent

Open source annotation tool for machine learning practitioners.

Data teams10.8KGone silent
bifrostmaximhq/bifrostStill shipping

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

Developers9.8KStill shipping
coaicoaidev/coaiGone silent

🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.

Developers9.3KGone silent
mission-controlbuilderz-labs/mission-controlStill shipping

Self-hosted control plane for AI agents: dispatch tasks, review runs, track spend, and operate OpenClaw, Claude Code, Codex, and other runtimes.

Developers6.5KStill shipping
gpustackgpustack/gpustackStill shipping

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

IT and operations6.1KStill shipping
KilnKiln-AI/KilnStill shipping

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

Data teams5.3KStill shipping
langwatchlangwatch/langwatchStill shipping

Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.

Developers5KStill shipping
How projects are grouped

Jev assigns one category from the repository name, description and homepage. Activity uses the last push to any branch.