Skip to content

Commit 7b57d90

Browse files
committed
improving handeling CCL lists
Signed-off-by: Vahid Janfaza <vjanfaza@qti.qualcomm.com>
1 parent 811b1ce commit 7b57d90

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

QEfficient/utils/check_ccl_specializations.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -12,12 +12,12 @@ def process_ccl_specializations(kwargs):
1212
ctx_len = kwargs.pop("ctx_len", None)
1313
prefill_seq_len = kwargs.pop("prefill_seq_len", 128)
1414

15-
if ctx_len is None:
16-
raise TypeError("`ctx_len` is required when loading the model.")
17-
1815
if ccl_prefill is None or ccl_decode is None:
1916
return None, None, ctx_len, prefill_seq_len
2017

18+
if ctx_len is None:
19+
raise TypeError("`ctx_len` is required when loading the model with CCL.")
20+
2121
if prefill_seq_len == 1:
2222
# both prefill and decode ccl can share the same specializations since prefill_seq_len=1. So, a sorted union of both lists can be used for both of them.
2323
ccl_union_all = sorted(set(ccl_prefill + ccl_decode))

0 commit comments

Comments
 (0)