openinfer-project/

pegainfer

GitHub Website

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

625stars

95forks

153issues

Apache-2.0license

2026since

Star historydaily snapshots by VibeCrowd

Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).

Alternatives & relatedmatched by topic overlap

vllm-project/

vllm

▲ 704/wk

A high-throughput and memory-efficient inference and serving engine for LLMs

88k20kPython

openinterpreter/

openinterpreter

▲ 178/wk

A coding agent for open models like Kimi K3

68k5.8kRust

mindsdb/

mindshub

▲ 14/wk

Make AI do actual work. Swap the model anytime — keep everything you've built.

40k6.2kMakefilegiant

diegosouzapw/

OmniRoute

▲ 6.3k/wk

Never stop coding. Free MIT AI gateway: one endpoint, 290+ providers (90+ free), 500+ models — Kimi, Claude, GPT, OpenAI, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 500+ contributors

39k5.2kTypeScript

Hmbown/

CodeWhale

▲ 245/wk

Open-source, community-driven agent harness

40k3.5kRust

ollama/

ollama

▲ 640/wk

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

178k17kGo

Comparepegainfer vs vllm pegainfer vs openinterpreter pegainfer vs mindshub

SharePost on X LinkedIn