We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 11339ad commit 3b54936Copy full SHA for 3b54936
docs/stable/store/quickstart.md
@@ -55,7 +55,7 @@ ln -s /mnt/nvme/models ./models
55
56
1. Convert a model to ServerlessLLM format and save it to a local path:
57
```python
58
-from serverless_llm_store import save_model
+from serverless_llm_store.transformers import save_model
59
60
# Load a model from HuggingFace model hub.
61
import torch
@@ -84,7 +84,7 @@ docker run -it --rm -v $PWD/models:/app/models checkpoint_store_server
84
85
import time
86
87
-from serverless_llm_store import load_model
+from serverless_llm_store.transformers import load_model
88
89
# warm up the GPU
90
num_gpus = torch.cuda.device_count()
0 commit comments