OpenPipe provides open-source tooling to fine-tune and host models, with Python and TypeScript SDKs, OpenAI-compatible endpoints, and local running steps. It supports fine-tuning GPT-3.5, Mistral, and Llama 2, plus dataset import and log querying.
Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).
What it is
OpenPipe is an open-source platform for fine-tuning and hosting models, offering OpenAI-compatible chat endpoints and the ability to switch between OpenAI models and fine-tuned alternatives. It provides Python and TypeScript SDKs and features for querying logs, importing datasets, and comparing output against base models.
How it works
The project exposes an OpenAI-compatible chat completions endpoint and supports fine-tuning of selected base models (GPT-3.5, Mistral, and Llama 2). It includes a local running path with a PostgreSQL database, Node.js-based server, and environment-driven configuration. Users can switch model targets by model name and compare outputs across models.
Getting started
"Running Locally" from the README:
- Install PostgreSQL.
- Install NodeJS 20.
- Install pnpm:
npm i -g pnpm. - Clone:
git clone https://github.com/openpipe/openpipe. - Install dependencies:
cd openpipe && pnpm install. - Create a .env file in app and set OPENAI_API_KEY.
- If using default DATABASE_URL, run:
psql postgres
CREATE ROLE postgres WITH LOGIN PASSWORD 'postgres';
ALTER ROLE postgres SUPERUSER;
- Update DATABASE_URL if needed and run
pnpm prisma migrate devin the app directory. - Create a GitHub OAuth App and set callback URL to your local instance path.
- Update GITHUB_CLIENT_ID and GITHUB_CLIENT_SECRET.
- Start the app:
pnpm devin theappdirectory. - Navigate to http://localhost:3000
Recent releases
- none
Traction
- Stars: 2822
- Forks: 178
- Open issues: 9
Caveats
- The README notes that development on the open-source version has been temporarily stopped to integrate proprietary third-party code. The repository may not reflect active open-source progress.
- License: Apache-2.0
- Created: 2023-06-20; last push: 2024-05-25
Details / Commands
- Running Locally commands shown in Getting started include: "pnpm install", "cd openpipe && pnpm install", "cd app && cp .env.example .env" (implied), and various setup steps; the provided code sample for using OpenPipe in Python shows how to instantiate OpenAI client with openpipe settings.