Skip to content

Commit 1d533ac

Browse files
committed
only set backed_size_oblivious if running sdpa in test_decoders
Signed-off-by: Joshua Rosenkranz <jmrosenk@us.ibm.com>
1 parent 1bf05bf commit 1d533ac

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tests/models/test_decoders.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -402,7 +402,7 @@ def get_or_create(self, is_gptq, is_fp8, **kwargs):
402402
self.__maybe_prepare_fp8_weights(model, is_fp8)
403403

404404
model.eval()
405-
fx_config.backed_size_oblivious = True
405+
fx_config.backed_size_oblivious = compile_dynamic_sendnn
406406
model.compile(
407407
backend="sendnn", options={"sendnn.dynamic": compile_dynamic_sendnn}
408408
)

0 commit comments

Comments
 (0)