llm-inspector

open-webui/

open-webui

▲ 729/wk

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

vllm-project/

vllm

▲ 704/wk

A high-throughput and memory-efficient inference and serving engine for LLMs

ray-project/

ray

▲ 65/wk

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

chatchat-space/

Langchain-Chatchat

▲ 24/wk

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

ollama/

ollama

▲ 640/wk

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

nomic-ai/

gpt4all

▲ 12/wk

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.