Update README.md
Browse files
README.md
CHANGED
|
@@ -41,8 +41,6 @@ llama-cli --hf-repo Sri-Vigneshwar-DJ/meta-llama/Llama-3.3-70B-4bit --hf-file FP
|
|
| 41 |
llama-server --hf-repo Sri-Vigneshwar-DJ/Llama-3.3-70B-4bit --hf-file FP8.gguf -c 2048
|
| 42 |
```
|
| 43 |
|
| 44 |
-
|
| 45 |
-
|
| 46 |
Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
|
| 47 |
|
| 48 |
Step 1: Clone llama.cpp from GitHub.
|
|
@@ -67,3 +65,5 @@ or
|
|
| 67 |
```
|
| 68 |
./llama-server --hf-repo Sri-Vigneshwar-DJ/Llama-3.3-70B-4bit --hf-file sFP8.gguf -c 2048
|
| 69 |
```
|
|
|
|
|
|
|
|
|
| 41 |
llama-server --hf-repo Sri-Vigneshwar-DJ/Llama-3.3-70B-4bit --hf-file FP8.gguf -c 2048
|
| 42 |
```
|
| 43 |
|
|
|
|
|
|
|
| 44 |
Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
|
| 45 |
|
| 46 |
Step 1: Clone llama.cpp from GitHub.
|
|
|
|
| 65 |
```
|
| 66 |
./llama-server --hf-repo Sri-Vigneshwar-DJ/Llama-3.3-70B-4bit --hf-file sFP8.gguf -c 2048
|
| 67 |
```
|
| 68 |
+
|
| 69 |
+
Step 4: On Ollama
|