Open Source Radar

Trending AI repositories

Tracked daily across the agentic ecosystem. Velocity is computed from our own snapshot history — collecting the first week of data now; repos are linked to the startups behind them.

1,381

Repos tracked

Linked to catalog

Jul 12

Last snapshot

TopicAll Agents MCP LLM RAG Coding agents Inference Vector DBs Browser

SortTrending Most stars Newest12 repos · page 1/1

flashinfer-ai/

flashinfer

FlashInfer: Kernel Library for LLM Serving

5.9k1.1kPython

lemonade-sdk/

lemonade

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

4.9k392C++

openlake-project/

openlake

OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

1.9k364Rust

beam-cloud/

beta9

Ultrafast serverless GPU inference, sandboxes, and background jobs

In catalog: Beam

1.7k145Go

jmerelnyc/

Talos

GPU worker client for the Talos network. Pairs with your Talos account, serves open-model inference jobs over a WebSocket, and reports uptime for payouts.

97316Python

DaoyuanLi2816/

can-i-finetune-this

Estimate whether a Hugging Face model fits and fine-tunes on your local GPU.

790106Python

kennss/

SiliconScope

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

69245Swift

yassa9/

qwen600

Static suckless single batch CUDA-only qwen3-0.6B mini inference engine

55648Cuda

openinfer-project/

openinfer

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

52976Rust

SikamikanikoBG/

homelab-monitor

Plug-and-play homelab dashboard in one container — GPU, local-AI VRAM, Docker, systemd, host health. Built-in read-only MCP server so AI agents can explore it too.

14923Python

RightNow-AI/

AutoMegaKernel

An agent harness that compiles a model into one provably-correct, self-retargeting CUDA megakernel and self-tunes it past cuBLAS at batch-1 LLM decode, paper: https://arxiv.org/abs/2606.09682

10210Python

wuxuedaifu/

vllm-chatterbox-stream

OpenAI-compatible multilingual TTS server — Chatterbox on vLLM with real-time PCM audio streaming, low time-to-first-byte (~0.7 s), voice cloning, and 23 languages.

552Python