Skip to content
This repository was archived by the owner on Oct 25, 2024. It is now read-only.

Commit 8fdde06

Browse files
authored
Fixed exmple error for Intel GPU WOQ (#1413)
Signed-off-by: Cheng Penghui <penghui.cheng@intel.com>
1 parent fd2516b commit 8fdde06

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

examples/huggingface/pytorch/text-generation/quantization/run_generation_gpu_woq.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -184,7 +184,7 @@
184184
if user_model is None else user_model
185185
user_model = user_model.to(memory_format=torch.channels_last)
186186
if quantization_config is None:
187-
quantization_config = user_model.quantization_config if hasattr(user_model, "quantization_config") else {}
187+
quantization_config = user_model.quantization_config if hasattr(user_model, "quantization_config") else None
188188
if not args.disable_optimize_transformers:
189189
print("Optimize with IPEX...")
190190
user_model = ipex.optimize_transformers(
@@ -273,7 +273,7 @@
273273
args.model, trust_remote_code=args.trust_remote_code, device_map=args.device, torch_dtype=torch_dtype) \
274274
if user_model is None else user_model
275275
if quantization_config is None:
276-
quantization_config = user_model.quantization_config if hasattr(user_model, "quantization_config") else {}
276+
quantization_config = user_model.quantization_config if hasattr(user_model, "quantization_config") else None
277277
if not args.disable_optimize_transformers:
278278
print("Optimize with IPEX...")
279279
user_model = ipex.optimize_transformers(

0 commit comments

Comments
 (0)