eide

BAAI-Agents/

Cradle

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.

TilelliLab/

atome-lm

A ternary, zero-heap tiny language model that runs inside a $2 microcontroller — bit-exact Python <-> C99 <-> Cortex-M3 (QEMU) parity. Apache-2.0.

alibaba/

MNN

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

cactus-compute/

cactus

▲ 14/wk

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

RightNow-AI/

picolm

Run a 1-billion parameter LLM on a $10 board with 256MB RAM

swellweb/

reame

CPU-first LLM inference server on llama.cpp. Runs useful models on free-tier ARM boxes; rewriting the input made it ~6x faster and more accurate than tuning the engine. MIT, benchmarks and failures included.