kennethleungty/

Llama-2-Open-Source-LLM-CPU-Inference

GitHub Website

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

971stars

206forks

15issues

MITlicense

2023since

Star historydaily snapshots by VibeCrowd

Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).

Alternatives & relatedmatched by topic overlap

chatchat-space/

Langchain-Chatchat

▲ 24/wk

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

39k6.3kPythonquiet

ymcui/

Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

19k1.8kPython

hiyouga/

LlamaFactory

▲ 162/wk

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

74k9.0kPython

StarTrail-org/

LEANN

▲ 22/wk

[MLsys2026]: RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

13k1.1kPython

vllm-project/

vllm

▲ 704/wk

A high-throughput and memory-efficient inference and serving engine for LLMs

88k20kPython

unslothai/

unsloth

▲ 524/wk

Unsloth is a local UI for training and running Kimi K3, Gemma 4, Qwen3.6, DeepSeek-V4, GLM and other models.

70k6.3kPython

CompareLlama-2-Open-Source-LLM-CPU-Inference vs Langchain-Chatchat Llama-2-Open-Source-LLM-CPU-Inference vs Chinese-LLaMA-Alpaca Llama-2-Open-Source-LLM-CPU-Inference vs LlamaFactory

SharePost on X LinkedIn