ODS turns a PC, Mac, or Linux box into a private AI server with local inference, UI, voice, agents, workflows, RAG, and image generation. It provides one-command installers and a docker-based stack for self-hosted AI.
Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).
What it is
ODS is a local AI server stack that wires together model inference, a chat UI, voice, agents, workflows, retrieval-augmented generation (RAG), and image generation to run on private hardware. It offers Linux/macOS one-command installers and a Windows PowerShell installer to set up the stack without manual integration of multiple components.
How it works
The project installs a pre-wired stack that includes local inference (llama-server), a chat UI (Open WebUI), a control dashboard, and additional services (voice, agents, workflows, RAG, privacy tools, observability). It uses Docker for service orchestration and provides platform-specific paths and port mappings. It supports cloud/hybrid modes as an option. The installer detects GPU hardware, selects a model catalog, and writes configuration like LLM_MODEL and GGUF_FILE to .env. It exposes local endpoints such as http://localhost:3000 for the UI, http://localhost:11434 for llama-server on Linux, and http://localhost:8080 for native macOS/Windows paths.
Getting started
Linux/macOS:
curl -fsSL https://install.osmantic.com/ods.sh | bash
Windows PowerShell:
$ProgressPreference = "SilentlyContinue"
$odsSrc = Join-Path $env:TEMP ("ods-install-" + [guid]::NewGuid().ToString("N"))
$odsZip = Join-Path $odsSrc "ods-main.zip"
New-Item -ItemType Directory -Path $odsSrc | Out-Null
Invoke-WebRequest "https://github.com/Osmantic/ODS/archive/refs/heads/main.zip" -OutFile $odsZip
Expand-Archive -LiteralPath $odsZip -DestinationPath $odsSrc -Force
cd (Get-ChildItem -LiteralPath $odsSrc -Directory | Select-Object -First 1).FullName
Set-ExecutionPolicy -Scope Process -ExecutionPolicy Bypass
.
ods.ps1
Prerequisites: Docker must be installed and running. Windows uses WSL2 backend.
After install, open http://localhost:3000 and start chatting.
Uninstall commands are provided in the README:
cd ~/ods
./ods-uninstall.sh --force
$installDir = "$env:USERPROFILE\ods"
cd $installDir
.\ods.ps1 uninstall --force
Recent releases
Latest: v2.6.0 ODS 2.6.0 (2026-07-28): ODS 2.6.0 includes remote-provider support, Model Switchboard and context selection, GPU reassignment rollback, rootless Linux repair, Windows/macOS native-runtime fi Earlier: v2.5.3 (2026-05-26), v2.5.2 (2026-05-26), v2.5.1 (2026-05-26), v2.5.0 (2026-05-21).
Traction
Stars: 3901 Forks: 572 Open issues: 306
Behind the repo
OSS project with multiple components including Open WebUI, llama-server, ComfyUI, n8n, and privacy/tools. Documentation references installer trust, release channels, and platform support matrices.
Caveats
License: Apache-2.0 Created: 2026-02-09 Last push: 2026-07-31 Platform support includes Linux, Windows (with WSL2), and macOS Apple Silicon. Windows requires Docker Desktop with WSL2 and may involve GPU passthrough considerations. Release validation and supported distros are documented in the repo. Port configurations are configurable via .env.example and install-time overrides.