Upload README.md
Browse files
README.md
CHANGED
|
@@ -20,17 +20,17 @@ License
|
|
| 20 |
|
| 21 |
ANEMLL is licensed under the MIT License.
|
| 22 |
https://opensource.org/license/mit
|
| 23 |
-
The model is based on Meta’s LLaMA 3.
|
| 24 |
|
| 25 |
|
| 26 |
|
| 27 |
-
This test model is exclusively for the
|
| 28 |
released before the official launch of the ANEMLL repository and minimal documentation.
|
| 29 |
It is intended for early adopters only who requested an early release.
|
| 30 |
|
| 31 |
|
| 32 |
Requirements
|
| 33 |
-
|
| 34 |
• CoreML Tools and HuggingFace Transformers libraries
|
| 35 |
• Python 3.9
|
| 36 |
|
|
@@ -47,7 +47,7 @@ python chat.py
|
|
| 47 |
Ctr-D to exit, Ctr-C to interrupt inference.
|
| 48 |
|
| 49 |
alternative way to run:
|
| 50 |
-
python chat.py
|
| 51 |
|
| 52 |
The first time the model loads, macOS will take some time to place it on the device.
|
| 53 |
Subsequent loads will be instantaneous.
|
|
|
|
| 20 |
|
| 21 |
ANEMLL is licensed under the MIT License.
|
| 22 |
https://opensource.org/license/mit
|
| 23 |
+
The model is based on Meta’s LLaMA 3.1 8B architecture and may require a separate license.
|
| 24 |
|
| 25 |
|
| 26 |
|
| 27 |
+
This test model is exclusively for the DeepSeek R1 8B model converted for CoreML,
|
| 28 |
released before the official launch of the ANEMLL repository and minimal documentation.
|
| 29 |
It is intended for early adopters only who requested an early release.
|
| 30 |
|
| 31 |
|
| 32 |
Requirements
|
| 33 |
+
• macOS Sequoia with Apple Neural Engine and 16GB RAM
|
| 34 |
• CoreML Tools and HuggingFace Transformers libraries
|
| 35 |
• Python 3.9
|
| 36 |
|
|
|
|
| 47 |
Ctr-D to exit, Ctr-C to interrupt inference.
|
| 48 |
|
| 49 |
alternative way to run:
|
| 50 |
+
python chat.py Q123 -d /path/to/anemll-DeepSeek-8B-ctx1024 ctx=1024
|
| 51 |
|
| 52 |
The first time the model loads, macOS will take some time to place it on the device.
|
| 53 |
Subsequent loads will be instantaneous.
|