openinference

BerriAI/

litellm

▲ 595/wk

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

langfuse/

langfuse

▲ 460/wk

🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

huggingface/

agents-course

▲ 186/wk

This repository contains the Hugging Face Agents Course.

open-webui/

open-webui

▲ 729/wk

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

headroomlabs-ai/

headroom

▲ 1.7k/wk

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

HKUDS/

nanobot

▲ 275/wk

Ultra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, tools, memory, MCP, multi-agent workflows, automation, and chat apps