Commit fe9f8da

committed

add bf16 trtllm gen

Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>

1 parent f25929f commit fe9f8daCopy full SHA for fe9f8da

4 files changed

+733

-2

lines changed

csrc
- trtllm_fused_moe_kernel_launcher.cu
flashinfer/fused_moe
- __init__.py
- core.py
tests/moe
- test_trtllm_gen_fused_moe.py

4 files changed

+733

-2

lines changed

Comments

(0)