LLMs & Model Tooling
Model-layer infrastructure: training, fine-tuning, prompting and everything that wraps a large language model.
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
Editor Code Assistant (ECA) - AI pair programming capabilities agnostic of editor
Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
List of awesome hosting sorted by minimal plan price
A highly optimized LLM inference acceleration engine for Llama and its variants.
Whale — blazingly fast, terminal-first AI coding agent for DeepSeek. ~98% prompt cache hit rate, 1M context, MCP tools, dynamic workflows.
🚀 Self-hosted AI automation platform. Deploy n8n, Ollama, Flowise, RAG, Supabase & 30+ tools with one command. Auto HTTPS. Free Zapier/Make alternative.
MCP server for semantic code research and context generation on real-time using LLM patterns | Search naturally across public & private repos based on your permissions | Transform any accessible codebase/s into AI-optimized knowledge on simple and complex flows | Find real implementations and live docs from anywhere
LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.
Read it. See it. Get it. Built at GDG AI Hack Milan 2026 for "Learn Different" track.
Epsilla is a high performance Vector Database Management System
Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
More is Different. A multi-agent world engine where AI agents live, talk, compete, ally.
LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.
An LLM-powered advanced RAG pipeline built from scratch
Official remote MCP server for Atlassian. Securely connect Jira, Confluence, Jira Service Management, Bitbucket, and Compass to Claude, ChatGPT, Cursor, VS Code, and other AI tools using OAuth 2.1 or API tokens.
“AI-Compass”将为社区指引在 AI 技术海洋中航行的方向，无论你是初学者还是进阶开发者，都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势，并通过实践掌握从理论到落地的全过程。
Autonomous self-evolving agents. Vision-grounded layered memory and self-written skills for LLM agents that operate your computer.
AINL helps turn AI from "a smart conversation" into "a structured worker." It is designed for teams building AI workflows that need multiple steps, state and memory, tool use, repeatable execution, validation and control, and lower dependence on long prompt loops. AINL is a compact, graph-canonical, AI-native programming system for (READ: README)
OpenSwarm — Autonomous AI dev team orchestrator powered by Claude Code CLI. Discord control, Linear integration, cognitive memory.
Llama 3+ inference in pure Java
Debug your AI agents
Agent工程师最全学习路径 · 从零精通 AI 工程 · 20 阶段 503 课 · 中文全量翻译 + 配套站点 + 动画讲解视频 · 如何成为 AI Agent 工程师的修成指南
Community edition of RepoPrompt: a native macOS context engineering app for AI coding agents, with an MCP CLI.
CORAL is a robust, lightweight infrastructure for multi-agent autonomous self-evolution, built for autoresearch. Works with Claude Code, Codex, Cursor, OpenCode, Kiro, and more.
Estimate whether a Hugging Face model fits and fine-tunes on your local GPU.
Token efficient Claude Code full Python rebuild. AI Coding Agent in 260K LoC pure Python. Up to 200X Cost Saving!
pi coding agent in a technicolor web trenchcoat
A Python library powered by Language Models (LLMs) for conversational data discovery and analysis.
AutoMem is a graph-vector memory service that gives AI assistants durable, relational memory: