Topic: large-scale-data-processing

NVIDIA-NeMo/

Curator

Scalable data pre processing and curation toolkit for LLMs

data-prep-kit/

data-prep-kit

Open source project for data preparation for GenAI applications