jzhang533 commited on
Commit
e86a970
·
verified ·
1 Parent(s): bad0889

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -8
README.md CHANGED
@@ -32,6 +32,9 @@ library_name: PaddlePaddle
32
 
33
  # ERNIE-4.5-0.3B-Base
34
 
 
 
 
35
  ## ERNIE 4.5 Highlights
36
 
37
  The advanced capabilities of the ERNIE 4.5 models, particularly the MoE-based A47B and A3B series, are underpinned by several key technical innovations:
@@ -110,14 +113,6 @@ result = tokenizer.decode(generated_ids[0].tolist(), skip_special_tokens=True)
110
  print("result:", result)
111
  ```
112
 
113
- ### vLLM inference
114
-
115
- vLLM is currently being adapted, priority can be given to using our forked repository [vllm](https://github.com/CSWYF3634076/vllm/tree/ernie). We are working with the community to fully support ERNIE4.5 models, stay tuned.
116
-
117
- ```bash
118
- vllm serve baidu/ERNIE-4.5-0.3B-Base-PT --trust-remote-code
119
- ```
120
-
121
  ## License
122
 
123
  The ERNIE 4.5 models are provided under the Apache License 2.0. This license permits commercial use, subject to its terms and conditions. Copyright (c) 2025 Baidu, Inc. All Rights Reserved.
 
32
 
33
  # ERNIE-4.5-0.3B-Base
34
 
35
+ > [!NOTE]
36
+ > Note: "**-Paddle**" models use [PaddlePaddle](https://github.com/PaddlePaddle/Paddle) weights, while "**-PT**" models use Transformer-style PyTorch weights.
37
+
38
  ## ERNIE 4.5 Highlights
39
 
40
  The advanced capabilities of the ERNIE 4.5 models, particularly the MoE-based A47B and A3B series, are underpinned by several key technical innovations:
 
113
  print("result:", result)
114
  ```
115
 
 
 
 
 
 
 
 
 
116
  ## License
117
 
118
  The ERNIE 4.5 models are provided under the Apache License 2.0. This license permits commercial use, subject to its terms and conditions. Copyright (c) 2025 Baidu, Inc. All Rights Reserved.