Update README.md
Browse filesvllm model card update
README.md
CHANGED
|
@@ -127,7 +127,11 @@ print(output_text)
|
|
| 127 |
|
| 128 |
### vLLM inference
|
| 129 |
|
| 130 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 131 |
|
| 132 |
## License
|
| 133 |
|
|
|
|
| 127 |
|
| 128 |
### vLLM inference
|
| 129 |
|
| 130 |
+
[vllm](https://github.com/vllm-project/vllm/tree/main) github library. Python-only [build](https://docs.vllm.ai/en/latest/getting_started/installation/gpu.html#set-up-using-python-only-build-without-compilation).
|
| 131 |
+
|
| 132 |
+
```bash
|
| 133 |
+
vllm serve baidu/ERNIE-4.5-VL-28B-A3B-PT --trust-remote-code
|
| 134 |
+
```
|
| 135 |
|
| 136 |
## License
|
| 137 |
|