Skip to content

Commit 8c25f9c

Browse files
authored
[BugFix] skip combo kernel on cpu (#29129)
Signed-off-by: Boyuan Feng <boyuan@meta.com>
1 parent 56e96b3 commit 8c25f9c

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

vllm/config/compilation.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -664,6 +664,8 @@ def __post_init__(self) -> None:
664664
is_torch_equal_or_newer("2.9.0.dev")
665665
and "combo_kernels" not in self.inductor_compile_config
666666
and "benchmark_combo_kernel" not in self.inductor_compile_config
667+
# (fixme @boyuan) combo kernel does not support cpu yet.
668+
and not current_platform.is_cpu()
667669
):
668670
# use horizontal fusion, which is useful for fusing qk-norm and
669671
# qk-rope when query and key have different shapes.

0 commit comments

Comments
 (0)