Skip to content

Commit 5ae73b8

Browse files
committed
Document Sync by Tina
1 parent d475314 commit 5ae73b8

File tree

2 files changed

+12
-2
lines changed

2 files changed

+12
-2
lines changed

docs/stable/getting_started/installation.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,5 +38,5 @@ To use vLLM with ServerlessLLM, we need to apply our patch `serverless_llm/store
3838

3939
You may do that by running our script:
4040
```bash
41-
./serverless_llm/store/patch.sh
41+
./serverless_llm/store/vllm_patch/patch.sh
4242
```

docs/stable/store/quickstart.md

Lines changed: 11 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -111,8 +111,18 @@ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
111111

112112
:::tip
113113
To use ServerlessLLM as the load format for vLLM, you need to apply our patch `serverless_llm/store/vllm_patch/sllm_load.patch` to the installed vLLM library. Therefore, please ensure you have applied our `vLLM Patch` as instructed in [installation guide](../getting_started/installation.md).
114+
115+
You may check the patch status by running the following command:
116+
``` bash
117+
./serverless_llm/store/vllm_patch/check_patch.sh
118+
```
119+
If the patch is not applied, you can apply it by running the following command:
120+
```bash
121+
./serverless_llm/store/vllm_patch/patch.sh
122+
```
123+
To remove the applied patch, you can run the following command:
114124
```bash
115-
./serverless_llm/store/patch.sh
125+
./serverless_llm/store/vllm_patch/remove_patch.sh
116126
```
117127
:::
118128

0 commit comments

Comments
 (0)