Dot is a standalone, open-source Electron app for interacting with documents using local LLMs and RAG. It loads multiple document types and uses local vector stores. It defaults to the Phi-3.5 LLM and supports Big Dot for non-document queries.
Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).
What it is
Dot is a standalone, open-source application designed for interaction with documents and files using local LLMs and Retrieval Augmented Generation (RAG). It is built as an Electron JS app and uses FAISS for local vector stores, Langchain, llama.cpp, and Huggingface for setup of conversation chains. It defaults to the Phi-3.5 LLM.
How it works
Dot loads multiple documents into an LLM and allows interactions in a fully local environment. Supported document types include PDF, DOCX, PPTX, XLSX, and more. It provides access to Big Dot for inquiries not directly related to documents. The architecture relies on local components: FAISS for vector storage, Langchain for orchestration, llama.cpp and Huggingface for LLM integration.
Getting started
To use Dot:
- Visit the Dot website to download the application for Apple Silicon or Windows. For developers:
- Clone the repository
$ https://github.com/alexpinel/Dot.git - Install Node js and then run
npm installinside the project repository, you can runnpm install --forceif you face any issues at this stage. Once complete, move tocd aadotllmand runnpm installonce more!
Recent releases
- v0.9.3 🔵 TWO STEP FORWARD, ONE STEP BACK 🔵 (2024-12-09): Finished my masters and can finally get back to working on Dot! This update is mainly focused on fixing bugs and compatibility issues, including a full rework of the backend.
- v0.9.2 🔵 TTS, WHISPER, SETTINGS, AND MUCH MORE!!! (2024-05-20): Made some changes and added a few features! As always Dot can be installed through the website, or the binaries can be found on this very release.
- v0.9.1 🔵 New features, changes, and fixes! (2024-04-14): Made some changes and added a few features! As always Dot can be installed through the website, or the binaries can be found on this very release.
- v0.9-beta Windows fix (2024-04-06): After some back and forth it looks like I manged to fix the problems with the windows version.
Traction
- Stars: 1909
- Forks: 110
- Open issues: 14
Behind the repo
- License: GPL-3.0
- Language: JavaScript
- Created: 2024-03-15
- Last push: 2024-12-09
Caveats
- License: GPL-3.0
- Open issues: 14
- Created: 2024-03-15
- Last push: 2024-12-09