ERNIE is PaddlePaddle's industrial toolkit and model family for ERNIE 4.5, including multimodal MoE LLMs and VL models, with ERNIEKit for training and deployment. It provides SFT/DPO/LoRA workflows, quantization, and various training/inference configurations. Latest release ERNIE-4.5 Open-source (2025-06-30).
Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).
What it is
The repository is the official source for ERNIE 4.5 and ERNIEKit, an industrial-grade development toolkit based on PaddlePaddle. It exposes model families including large language models (LLMs), vision-language models (VLMs), and dense models, plus tooling for training, fine-tuning, and deployment. It also references integration points to Hugging Face and AI Studio.
How it works
ERNIE 4.5 models are described as multimodal, using a heterogeneous MoE architecture with parameter sharing across modalities and modality-isolated routing. Training and inference leverage PaddlePaddle with support for SFT, LoRA, DPO, and combinations thereof. Inference and deployment support quantization and multi-hardware configurations via ERNIEKit and FastDeploy. The model table lists training and inference support per variant, including quantization schemes.
Getting started
Key starting points include:
- Quick Start section under ERNIEKit: "When you install ERNIEKit successfully, you can start training ERNIE 4.5 models with the following command:" followed by a shell example
- Example commands shown in README: install/train sequences such as downloading models from Hugging Face and running erniekit train with configuration files
- Quick Start command snippet:
huggingface-cli download baidu/ERNIE-4.5-0.3B-Paddle --local-dir baidu/ERNIE-4.5-0.3B-Paddle
# 8K Sequence Length, SFT
erniekit train examples/configs/ERNIE-4.5-0
Recent releases
- ernie-4.5 ERNIE 4.5 Open-source (2025-06-30): # ERNIE 4.5
- ERNIE 4.5 family comprises models such as ERNIE-4.5-300B-A47B-Base, ERNIE-4.5-VL-424B-A47B-Base, ERNIE-4.5-0.3B-Base, and others in the table. ERNIEKit has v1.5, v1.4, v1.3, v1.2, v1.1, and v1.0 releases noted in the updates.
Traction
- Stars: 7734
- Forks: 1444
- Open issues: 84
Behind the repo
- Not applicable: no linked startup/company section is provided beyond project context and collaborations with Hugging Face and AI Studio
Caveats
- License: Apache-2.0
- Created: 2019-03-03
- Last push: 2026-07-24
- The README indicates multiple model variants with names and training/inference capabilities; some entries are labeled as "Coming Soon" (e.g., ERNIE-4.5-VL-424B-A47B-Base and related VL models in the training column)