Skip to content

Commit 244617d

Browse files
authored
Update deploy-openai-llm-byoc.md
1 parent 225c41a commit 244617d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

LLM/deploy-openai-llm-byoc.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -196,7 +196,7 @@ cmd_var = [
196196
"--model",
197197
f"/opt/ds/model/deployed_model/{model_prefix}",
198198
"--tensor-parallel-size",
199-
"2",
199+
"8",
200200
"--port",
201201
"8080",
202202
"--served-model-name",

0 commit comments

Comments
 (0)