Trending AI repositories

huggingface/

transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

rasbt/

LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

vllm-project/

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

ray-project/

ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

deepset-ai/

haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

arc53/

DocsGPT

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

activeloopai/

deeplake

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

flashinfer-ai/

flashinfer

FlashInfer: Kernel Library for LLM Serving

kserve/

kserve

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

superduper-io/

superduper

Superduper: End-to-end framework for building custom AI applications and agents.

yanshengjia/

ml-road

Machine Learning and Agentic AI Resources, Practice and Research

predibase/

lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

zhaoyingjun/

chatbot

Chatbot继续沿着LLM前进，近期更新小参数量SLM的和训练脚本，支持本地训练。新增ChatAgent,实现各种有实际场景价值的Agent实现。

walkinglabs/

hands-on-modern-rl

🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.

raiyanyahya/

how-to-train-your-gpt

Build a modern LLM from scratch. Every line commented. Explained like we are five.

zhihu/

ZhiLight

A highly optimized LLM inference acceleration engine for Llama and its variants.

DaoyuanLi2816/

can-i-finetune-this

Estimate whether a Hugging Face model fits and fine-tunes on your local GPU.

feifeibear/

long-context-attention

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

rohan-paul/

LLM-FineTuning-Large-Language-Models

LLM (Large Language Model) FineTuning

zengxiao-he/

tessera

From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.

microsoft/

sarathi-serve

A low-latency & high-throughput serving engine for LLMs

Abishek-kk/

RailMind-AI

Agentic AI platform transforming passive CCTV into proactive railway safety intelligence. Real-time behavioural detection (suicide risk, pickpocketing) via YOLOv8 + BiLSTM + multi-agent reasoning — zero new hardware, privacy-first, no facial recognition.

wuxuedaifu/

vllm-chatterbox-stream

OpenAI-compatible multilingual TTS server — Chatterbox on vLLM with real-time PCM audio streaming, low time-to-first-byte (~0.7 s), voice cloning, and 23 languages.