Update README.md
Browse files
README.md
CHANGED
|
@@ -32,6 +32,9 @@ library_name: PaddlePaddle
|
|
| 32 |
|
| 33 |
# ERNIE-4.5-0.3B-Base
|
| 34 |
|
|
|
|
|
|
|
|
|
|
| 35 |
## ERNIE 4.5 Highlights
|
| 36 |
|
| 37 |
The advanced capabilities of the ERNIE 4.5 models, particularly the MoE-based A47B and A3B series, are underpinned by several key technical innovations:
|
|
@@ -110,14 +113,6 @@ result = tokenizer.decode(generated_ids[0].tolist(), skip_special_tokens=True)
|
|
| 110 |
print("result:", result)
|
| 111 |
```
|
| 112 |
|
| 113 |
-
### vLLM inference
|
| 114 |
-
|
| 115 |
-
vLLM is currently being adapted, priority can be given to using our forked repository [vllm](https://github.com/CSWYF3634076/vllm/tree/ernie). We are working with the community to fully support ERNIE4.5 models, stay tuned.
|
| 116 |
-
|
| 117 |
-
```bash
|
| 118 |
-
vllm serve baidu/ERNIE-4.5-0.3B-Base-PT --trust-remote-code
|
| 119 |
-
```
|
| 120 |
-
|
| 121 |
## License
|
| 122 |
|
| 123 |
The ERNIE 4.5 models are provided under the Apache License 2.0. This license permits commercial use, subject to its terms and conditions. Copyright (c) 2025 Baidu, Inc. All Rights Reserved.
|
|
|
|
| 32 |
|
| 33 |
# ERNIE-4.5-0.3B-Base
|
| 34 |
|
| 35 |
+
> [!NOTE]
|
| 36 |
+
> Note: "**-Paddle**" models use [PaddlePaddle](https://github.com/PaddlePaddle/Paddle) weights, while "**-PT**" models use Transformer-style PyTorch weights.
|
| 37 |
+
|
| 38 |
## ERNIE 4.5 Highlights
|
| 39 |
|
| 40 |
The advanced capabilities of the ERNIE 4.5 models, particularly the MoE-based A47B and A3B series, are underpinned by several key technical innovations:
|
|
|
|
| 113 |
print("result:", result)
|
| 114 |
```
|
| 115 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 116 |
## License
|
| 117 |
|
| 118 |
The ERNIE 4.5 models are provided under the Apache License 2.0. This license permits commercial use, subject to its terms and conditions. Copyright (c) 2025 Baidu, Inc. All Rights Reserved.
|