Skip to content

Commit 7ae5a5f

Browse files
authored
[Misc] Add some comments in qwen3-next (vllm-project#28267)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
1 parent de2b783 commit 7ae5a5f

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

vllm/model_executor/models/qwen3_next.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -462,6 +462,8 @@ def forward(
462462
# ============================================================
463463
# Part 2: Core Attention (Custom Op)
464464
# ============================================================
465+
# Note: we should not use torch.empty here like other attention backends,
466+
# see discussions in https://github.com/vllm-project/vllm/pull/28182
465467
core_attn_out = torch.zeros(
466468
(num_tokens, self.num_v_heads // self.tp_size, self.head_v_dim),
467469
dtype=hidden_states.dtype,

0 commit comments

Comments
 (0)