Open Computer Use is a Python-based agent system that uses a secure desktop sandbox and multiple open-source LLM providers to control a cloud Linux computer. It supports plugging in various models and streams the sandbox display to the client.
Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).
What it is
Open Computer Use is a secure cloud Linux computer powered by E2B Desktop Sandbox and controlled by open-source LLMs. It operates the computer via keyboard, mouse, and shell commands, and streams the sandbox display to the client. It is designed to work with Ubuntu but aims to be OS-agnostic.
How it works
The system integrates a Desktop Sandbox from E2B and uses LLMs to ground, vision, and act in the environment. The LLMs are configured in config.py with providers.py supporting multiple backends (e.g., Fireworks, OpenRouter, Llama API, Groq, DeepSeek, Google Gemini 2.0 Flash, OpenAI, Anthropic Claude, HuggingFace, Moonshot, Mistral). The configuration examples show grounding_model, vision_model, and action_model selections such as:
grounding_model = providers.OSAtlasProvider()
vision_model = providers.GroqProvider("llama3.2")
action_model = providers.GroqProvider("llama3.3")
The README lists the set of providers and corresponding capabilities (vision, action, or both).
Getting started
Prerequisites include Python 3.10+, git, an E2B API key, and an API key for an LLM provider. The installation steps are:
- Install prerequisites:
brew install poetry ffmpeg
- Clone the repository:
git clone https://github.com/e2b-dev/open-computer-use/
- Set environment variables in a .env file within the project:
# E2B API key
E2B_API_KEY="your-e2b-api-key"
Additional API keys for providers such as FIREWORKS_API_KEY, OPENROUTER_API_KEY, GROQ_API_KEY, OPENAI_API_KEY, ANTHROPIC_API_KEY, MOONSHOT_API_KEY, HF_TOKEN, etc. as required by config.py.
- Start the web interface:
poetry install
poetry run start
To start with a specified prompt:
poetry run start --prompt "use the web browser to get the current weather in sf"
The display stream becomes visible a few seconds after the Python program starts.
Recent releases
- latest: none
Traction
- Stars: 2186
- Forks: 249
- Open issues: 18
Caveats
- License: Apache-2.0
- Created: 2024-10-31
- Last push: 2026-07-09
- Language: Python
- This section reflects repository metadata and does not summarize content beyond what is stated in the README and facts block.