mistralai
/

Mistral-Large-Instruct-2411

Model card Files Files and versions

patrickvonplaten commited on Nov 19, 2024

Commit

3a5cb13

·

verified ·

1 Parent(s): e5e6759

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -336,7 +336,7 @@ using [`mistral_common >= 1.5.0`](https://github.com/mistralai/mistral-common/re
 Make sure to serve the model with the following flags in vLLM:
 ```
-vllm serve mistralai/Pixtral-Large-Instruct-2411 --tokenizer_mode mistral --tensor-parallel-size 8 --tool-call-parser mistral --enable-auto-tool-choice
 ```
 <details>

 Make sure to serve the model with the following flags in vLLM:
 ```
+vllm serve mistralai/Pixtral-Large-Instruct-2411 --tokenizer_mode mistral --config_format mistral --load_format mistral --tensor-parallel-size 8 --tool-call-parser mistral --enable-auto-tool-choice
 ```
 <details>