RadarTopicsBuildersWeeklyReads
Open Source Radar

Topic: pretraining

← Back to the radar
CategoriesAgentsMCPCoding agentsLLMRAGInferenceVector DBsBrowserWorkflowstopic: pretraining
SortTrendingMost starsNewest9 repos · page 1/1
rasbt/
LLMs-from-scratch
487/wk

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

101k15kJupyter Notebook✓ Reviewed
couragec/
LLMInternSkill
3/wk

LLMInternSkill: LLM internship resume and job-search Codex Skill for resume polish, JD tailoring, evidence guard, interview grilling, and Project Scout. 大模型实习简历与求职工具箱。

25511Markdownnew✓ Reviewed
LlamaChinese/
Llama-Chinese

Llama中文社区,实时汇总最新Llama学习资料,构建最好的中文Llama大模型开源生态,完全开源可商用

15k1.3kPythonquiet✓ Reviewed
microsoft/
LMOps

General technology for enabling AI capabilities w/ LLMs and MLLMs

4.5k377Python
InternScience/
GraphGen

GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation

1.2k88Python
zubair-irshad/
Awesome-Robotics-3D

A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites

82042quiet
cxcscmu/
Craw4LLM

Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"

66060Pythonquiet
wanyichen06/
LLMInternSkill

LLMInternSkill: LLM internship resume and job-search Codex Skill for resume polish, JD tailoring, evidence guard, interview grilling, and Project Scout. 大模型实习简历与求职工具箱。

26311Markdownnew
Enping-Hu/
minimind-deep-dive

从 MiniMind 源码读起,再延伸到现代大模型技术体系的中文学习笔记。主线逐行精读预训练 / SFT / DPO / PPO / GRPO 与训练机制;附录 17 篇进阶卷覆盖量化、投机解码、RLHF 全景、模型代际史等 MiniMind 没涉及、但进阶绕不开的主题。

19111Pythonnew