Update README.md
Browse files
README.md
CHANGED
|
@@ -103,12 +103,10 @@ We recommend using this model with [vLLM](https://github.com/vllm-project/vllm).
|
|
| 103 |
|
| 104 |
#### Installation
|
| 105 |
|
| 106 |
-
Make sure to install
|
| 107 |
|
| 108 |
```
|
| 109 |
-
|
| 110 |
-
--torch-backend=auto \
|
| 111 |
-
--extra-index-url https://wheels.vllm.ai/nightly
|
| 112 |
```
|
| 113 |
|
| 114 |
Doing so should automatically install [`mistral_common >= 1.8.6`](https://github.com/mistralai/mistral-common/releases/tag/v1.8.6).
|
|
@@ -118,7 +116,7 @@ To check:
|
|
| 118 |
python -c "import mistral_common; print(mistral_common.__version__)"
|
| 119 |
```
|
| 120 |
|
| 121 |
-
You can also make use of a ready-to-go [docker image](https://github.com/vllm-project/vllm/blob/main/Dockerfile) or on the [docker hub](https://hub.docker.com/layers/vllm/vllm-openai/latest/images/sha256-
|
| 122 |
|
| 123 |
#### Serve
|
| 124 |
|
|
|
|
| 103 |
|
| 104 |
#### Installation
|
| 105 |
|
| 106 |
+
Make sure to install **vllm >= 1.12.0**:
|
| 107 |
|
| 108 |
```
|
| 109 |
+
pip install vllm --upgrade
|
|
|
|
|
|
|
| 110 |
```
|
| 111 |
|
| 112 |
Doing so should automatically install [`mistral_common >= 1.8.6`](https://github.com/mistralai/mistral-common/releases/tag/v1.8.6).
|
|
|
|
| 116 |
python -c "import mistral_common; print(mistral_common.__version__)"
|
| 117 |
```
|
| 118 |
|
| 119 |
+
You can also make use of a ready-to-go [docker image](https://github.com/vllm-project/vllm/blob/main/docker/Dockerfile) or on the [docker hub](https://hub.docker.com/layers/vllm/vllm-openai/latest/images/sha256-f2309d913a07da49ea20b2a694703f4cfcb5ad8e7437ec0f26145479ac01e002).
|
| 120 |
|
| 121 |
#### Serve
|
| 122 |
|