Topic: pre-training

RUCAIBox/

LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

datajuicer/

data-juicer

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

EgoAlpha/

prompt-in-context-learning

Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates.

nancheng58/

Awesome-LLM4RS-Papers

Large Language Model-enhanced Recommender System Papers

cxcscmu/

Craw4LLM

Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"

princeton-nlp/

LLM-Shearing

[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning