tt-metal

vllm-project/

vllm

▲ 704/wk

A high-throughput and memory-efficient inference and serving engine for LLMs

ollama/

ollama

▲ 640/wk

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

hiyouga/

LlamaFactory

▲ 162/wk

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

unslothai/

unsloth

▲ 524/wk

Unsloth is a local UI for training and running Kimi K3, Gemma 4, Qwen3.6, DeepSeek-V4, GLM and other models.

huggingface/

transformers

▲ 266/wk

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

mudler/

LocalAI

▲ 272/wk

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.