SemiAnalysisAI/

InferenceX

GitHub Website

Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | 开源持续推理基准研究平台 — Kimi K2.7-Code、MiniMax M3、DeepSeekv4、GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72，即将推出™ TPUv6e/v7/Trainium2/3

1.3kstars

247forks

217issues

Apache-2.0license

2025since

Star historydaily snapshots by VibeCrowd

Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).

Alternatives & relatedmatched by topic overlap

vllm-project/

vllm

▲ 704/wk

A high-throughput and memory-efficient inference and serving engine for LLMs

88k20kPython

mindsdb/

mindshub

▲ 14/wk

Make AI do actual work. Swap the model anytime — keep everything you've built.

40k6.2kMakefilegiant

huggingface/

transformers

▲ 266/wk

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.