Skip to content

Commit d475314

Browse files
committed
Document Sync by Tina
1 parent 68ed6f6 commit d475314

File tree

2 files changed

+3
-5
lines changed

2 files changed

+3
-5
lines changed

docs/stable/getting_started/installation.md

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -36,8 +36,7 @@ pip install -i https://test.pypi.org/simple/ --extra-index-url https://pypi.org/
3636
# vLLM Patch
3737
To use vLLM with ServerlessLLM, we need to apply our patch `serverless_llm/store/vllm_patch/sllm_load.patch` to the vLLM repository. Currently, the patch is only tested with vLLM version `0.5.0`.
3838

39-
You may do that by running the following commands:
39+
You may do that by running our script:
4040
```bash
41-
VLLM_PATH=$(python -c "import vllm; import os; print(os.path.dirname(os.path.abspath(vllm.__file__)))")
42-
patch -p2 -d $VLLM_PATH < serverless_llm/store/vllm_patch/sllm_load.patch
41+
./serverless_llm/store/patch.sh
4342
```

docs/stable/store/quickstart.md

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -112,8 +112,7 @@ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
112112
:::tip
113113
To use ServerlessLLM as the load format for vLLM, you need to apply our patch `serverless_llm/store/vllm_patch/sllm_load.patch` to the installed vLLM library. Therefore, please ensure you have applied our `vLLM Patch` as instructed in [installation guide](../getting_started/installation.md).
114114
```bash
115-
VLLM_PATH=$(python -c "import vllm; import os; print(os.path.dirname(os.path.abspath(vllm.__file__)))")
116-
patch -p2 -d $VLLM_PATH < serverless_llm/store/vllm_patch/sllm_load.patch
115+
./serverless_llm/store/patch.sh
117116
```
118117
:::
119118

0 commit comments

Comments
 (0)