Skip to content

Commit 8fb6f50

Browse files
committed
Update documentation from main repository
1 parent 41cd3f7 commit 8fb6f50

File tree

4 files changed

+4
-4
lines changed

4 files changed

+4
-4
lines changed

docs/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# ServerlessLLM documents
22

3-
Please find our documents in [ServerlessLLM](https://serverlessllm.github.io/docs/getting_started).
3+
Please find our documents in [ServerlessLLM](https://serverlessllm.github.io/docs/intro).
44

55
## How to build ServerlessLLM Docs
66

docs/api/sllm-store-cli.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -208,7 +208,7 @@ sllm-store load [OPTIONS]
208208
- Adapter name to save. Must be a Hugging Face pretrained LoRA adapter name.
209209

210210
- `--precision <precision>`
211-
- Precision to use when loading the model (`transformers` backend only). For more info on quantization in ServerlessLLM, visit [here](https://serverlessllm.github.io/docs/store/quickstart#quantization).
211+
- Precision to use when loading the model (`transformers` backend only). For more info on quantization in ServerlessLLM, visit [here](../store/quantization.md).
212212

213213
- `--storage-path <storage_path>`
214214
- Location where the model will be loaded from.

docs/developer/supporting_a_new_hardware.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ Hardware is considered supported by ServerlessLLM if:
1818
- For non-CUDA-compatible APIs, implementing a custom checkpoint loading function might be required.
1919

2020
## Verifying Hardware Support in ServerlessLLM Store
21-
The hardware support is verified if it successfully completes the [Quick Start Guide](https://serverlessllm.github.io/docs/getting_started/) examples, showcasing checkpoint loading and inference functionality without errors.
21+
The hardware support is verified if it successfully completes the [Quick Start Guide](../getting_started.md) examples, showcasing checkpoint loading and inference functionality without errors.
2222

2323
If the hardware is not publicly available (i.e., can't be tested by the ServerlessLLM team), a screenshot or output log of the successful execution of the Quick Start Guide examples is required to verify hardware support.
2424

docs/store/rocm_quickstart.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -135,7 +135,7 @@ Prompt: 'Hello, my name is', Generated text: ' Joel, my dad is my friend and we
135135
Prompt: 'The president of the United States is', Generated text: ' speaking out against the release of some State Department documents which show the Russians were involved'
136136
Prompt: 'The capital of France is', Generated text: ' a worldwide knowledge center. What better place to learn about the history and culture of'
137137
Prompt: 'The future of AI is', Generated text: " here: it's the future of everything\nIf you want to test your minds"
138-
[rank0]:[W605 13:03:30.532018298 ProcessGroupNCCL.cpp:1476] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/distributed.html#shutdown (function operator())
138+
[rank0]:[W605 13:03:30.532018298 ProcessGroupNCCL.cpp:1476] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
139139
```
140140
141141
## Build the wheel from source and install

0 commit comments

Comments
 (0)