RunAnywhere-sdks is a multi-platform on-device AI SDK suite with a single C++ core and language bindings for Swift, Kotlin, Flutter, React Native, Web, Electron, Python, and a CLI. It targets local AI workloads across devices, offering LLMs, vision, speech, and RAG capabilities.
Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).
What it is
Production-ready toolkit to run AI locally. It provides a single C/C++ core and multiple language SDKs to build on-device AI features such as LLM generation, vision, speech, embeddings, RAG, and image generation across mobile, desktop, web, and server environments.
How it works
Eight SDKs over one C++ core. Engines register what they can run and a capability registry routes calls to the highest-priority engine available (QHexRT on Snapdragon Hexagon NPU, MLX on Apple silicon, llama.cpp, sherpa + ONNX, Core ML). The SDKs expose a consistent API across platforms, with per-platform bindings and backends.
Getting started
The Quick start shows installation and usage, including Python and CLI examples:
pip install runanywhere
from runanywhere import RunAnywhere
with RunAnywhere() as ra:
llm = ra.load_llm("qwen2.5-0.5b") # downloads on first use
print(llm.generate_text("Explain on-device AI in one sentence."))
brew install runanywhere-ai/tap/rcli
rcli run qwen3 "Explain on-device AI in one sentence."
Details for platform-specific bindings (Swift, Kotlin, Flutter, React Native, Web, Electron, Python, rcli) are provided with code samples in the README, including model loading and generation flows for each stack.
Recent releases
Latest releases include v0.20.12 (2026-07-29) with Kotlin/Android Maven Central artifacts, and prior v0.20.11 (2026-07-27) and v0.20.10 (2026-07-14). The changelogs reference cross-platform SDKs and fixes.
Traction
Stars: 10301 Forks: 365 Open issues: 25
Behind the repo
No linked startup/company section is present in the provided facts.
Caveats
License: none listed. Created: 2025-07-22. Last push: 2026-08-04. Open issues: 25. Projects include multiple language bindings and platforms with a shared core version 0.20.11 across SDKs. Release notes indicate cross-target and build notes (e.g., opt-in backends, platform specifics).