Must-read Papers on LLM Agents.
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
PhoGPT: Generative Pre-training for Vietnamese (2023)