Skip to content

Commit 11339ad

Browse files
committed
Document Sync by Tina
1 parent 13dc664 commit 11339ad

File tree

1 file changed

+32
-0
lines changed

1 file changed

+32
-0
lines changed

docs/stable/cli/cli_api.md

Lines changed: 32 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -169,6 +169,38 @@ sllm-cli generate --threads 4 /path/to/request.json
169169
}
170170
```
171171

172+
### sllm-cli encode (embedding)
173+
Get the embedding using the deployed model.
174+
175+
##### Usage
176+
```bash
177+
sllm-cli encode [OPTIONS] <input_path>
178+
```
179+
180+
##### Options
181+
- `-t`, `--threads <num_threads>`
182+
- Number of parallel encoding processes. Default is 1.
183+
184+
##### Arguments
185+
- `input_path`
186+
- Path to the JSON input file.
187+
188+
##### Example
189+
```bash
190+
sllm-cli encode --threads 4 /path/to/request.json
191+
```
192+
193+
##### Example Request File (`request.json`)
194+
```json
195+
{
196+
"model": "intfloat/e5-mistral-7b-instruct",
197+
"task_instruct": "Given a question, retrieve passages that answer the question",
198+
"query": [
199+
"Hi, How are you?"
200+
]
201+
}
202+
```
203+
172204
### sllm-cli replay
173205
Replay requests based on workload and dataset.
174206

0 commit comments

Comments
 (0)