Skip to content

Commit c36f144

Browse files
authored
[None][chore] Fix trtllm-eval for PyTorchLLM (#9427)
Signed-off-by: Fanrong Li <23290157+lfr-0531@users.noreply.github.com>
1 parent 6078657 commit c36f144

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

tensorrt_llm/commands/eval.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -135,6 +135,7 @@ def main(ctx, model: str, tokenizer: Optional[str], log_level: str,
135135

136136
profiler.start("trtllm init")
137137
if backend == 'pytorch':
138+
llm_args.pop("build_config", None)
138139
llm = PyTorchLLM(**llm_args)
139140
elif backend == 'tensorrt':
140141
llm = LLM(**llm_args)

0 commit comments

Comments
 (0)