casbin-gateway

headroomlabs-ai/

headroom

▲ 1.7k/wk

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

BerriAI/

litellm

▲ 595/wk

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

ollama/

ollama

▲ 640/wk

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

mudler/

LocalAI

▲ 272/wk

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

milvus-io/

milvus

▲ 105/wk

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

affaan-m/

ECC

▲ 2.9k/wk

The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.