Update README.md
Browse files
README.md
CHANGED
|
@@ -73,11 +73,11 @@ Note: BF16 is currently only supported on CPU.
|
|
| 73 |
|
| 74 |
## Hardware Choices (LLaMA3 70B Specific)
|
| 75 |
|
| 76 |
-
Any Macbook with a Metal GPU and 32GB should in theory be able to
|
| 77 |
-
Meta-Llama-3-70B-Instruct.Q2\_K.llamafile reasonably well, provided
|
| 78 |
-
close all your browser tabs. At this lowliest of quantization
|
| 79 |
-
llama3 is still smart enough to solve math riddles, but you
|
| 80 |
-
expect more hallucinations than usual.
|
| 81 |
|
| 82 |
If you want to run Q4\_0 you'll probably be able to squeeze it on a
|
| 83 |
$3,999.00 Macbook Pro M3 Max w/ 48GB of RAM.
|
|
|
|
| 73 |
|
| 74 |
## Hardware Choices (LLaMA3 70B Specific)
|
| 75 |
|
| 76 |
+
Any Macbook with a Metal GPU and 32GB of RAM should in theory be able to
|
| 77 |
+
run Meta-Llama-3-70B-Instruct.Q2\_K.llamafile reasonably well, provided
|
| 78 |
+
you close all your browser tabs. At this lowliest of quantization
|
| 79 |
+
levels, llama3 is still smart enough to solve math riddles, but you
|
| 80 |
+
should expect more hallucinations than usual.
|
| 81 |
|
| 82 |
If you want to run Q4\_0 you'll probably be able to squeeze it on a
|
| 83 |
$3,999.00 Macbook Pro M3 Max w/ 48GB of RAM.
|