Skip to content

Commit 307af29

Browse files
committed
fix mtp error
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
1 parent fd860ff commit 307af29

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/worker/model_runner_v1.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2510,7 +2510,7 @@ def sample_tokens(
25102510
valid_sampled_token_ids = sampled_token_ids.tolist()
25112511
else:
25122512
# Includes spec decode tokens. It's a numpy array
2513-
valid_sampled_token_ids = self.rejection_sampler.parse_output(
2513+
valid_sampled_token_ids, _ = self.rejection_sampler.parse_output(
25142514
sampled_token_ids,
25152515
self.input_batch.vocab_size,
25162516
)

0 commit comments

Comments
 (0)