Trending AI repositories

ollama/

ollama

Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

vllm-project/

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

hiyouga/

LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

unslothai/

unsloth

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.

mudler/

LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

chatchat-space/

Langchain-Chatchat

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

AstrBotDevs/

AstrBot

AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨

sgl-project/

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

yamadashy/

repomix

📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.

cheahjs/

free-llm-api-resources

A list of free LLM inference resources accessible via API.

AiHubCN/

Awesome-Chinese-LLM

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

lyogavin/

airllm

AirLLM 70B inference with single 4GB GPU

langchain4j/

langchain4j

LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.

bentoml/

OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

dataelement/

bisheng

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

Tiiny-AI/

PowerInfer

High-speed Large Language Model Serving for Local Deployment

WangRongsheng/

awesome-LLM-resources

🧑‍🚀 全世界最好的LLM资料总结（多模态生成、Agent、辅助编程、AI审稿、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型） | Summary of the world's best LLM resources.

InternLM/

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

mishushakov/

llm-scraper

Turn any webpage into structured data using LLMs

Michael-A-Kuykendall/

shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

gpustack/

gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

lemonade-sdk/

lemonade

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

predibase/

lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

johnbean393/

Sidekick

A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp.

raiyanyahya/

how-to-train-your-gpt

Build a modern LLM from scratch. Every line commented. Explained like we are five.

sauravpanda/

BrowserAI

Run local LLMs like llama, deepseek-distill, kokoro and more inside your browser

zhihu/

ZhiLight

A highly optimized LLM inference acceleration engine for Llama and its variants.

mukel/

llama3.java

Llama 3+ inference in pure Java

andrewkchan/

yalm

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

DonTizi/

ReMind

Your Local Artificial Memory on your Device.