File tree Expand file tree Collapse file tree 1 file changed +32
-0
lines changed Expand file tree Collapse file tree 1 file changed +32
-0
lines changed Original file line number Diff line number Diff line change @@ -169,6 +169,38 @@ sllm-cli generate --threads 4 /path/to/request.json
169169}
170170` ` `
171171
172+ # ## sllm-cli encode (embedding)
173+ Get the embedding using the deployed model.
174+
175+ # #### Usage
176+ ` ` ` bash
177+ sllm-cli encode [OPTIONS] < input_path>
178+ ` ` `
179+
180+ # #### Options
181+ - ` -t` , ` --threads < num_threads> `
182+ - Number of parallel encoding processes. Default is 1.
183+
184+ # #### Arguments
185+ - ` input_path`
186+ - Path to the JSON input file.
187+
188+ # #### Example
189+ ` ` ` bash
190+ sllm-cli encode --threads 4 /path/to/request.json
191+ ` ` `
192+
193+ # #### Example Request File (`request.json`)
194+ ` ` ` json
195+ {
196+ " model" : " intfloat/e5-mistral-7b-instruct" ,
197+ " task_instruct" : " Given a question, retrieve passages that answer the question" ,
198+ " query" : [
199+ " Hi, How are you?"
200+ ]
201+ }
202+ ` ` `
203+
172204# ## sllm-cli replay
173205Replay requests based on workload and dataset.
174206
You can’t perform that action at this time.
0 commit comments