Skip to content

Commit 708630f

Browse files
committed
minor
Signed-off-by: Kinjal Patel <kinjalpravin@nvidia.com>
1 parent 7c6d63f commit 708630f

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

modelopt/torch/export/unified_export_megatron.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -537,7 +537,9 @@ def save_pretrained(
537537
and self._hf_config is not None
538538
and pretrained_model_name_or_path is not None
539539
):
540-
# Nemotron-H model requires configuration and modeling files to run with vLLM
540+
# For models that keep configuration and modeling files as part of the checkpoint,
541+
# we need to copy them to the export directory for seamless integration with inference
542+
# frameworks.
541543
hf_checkpoint_path = Path(pretrained_model_name_or_path)
542544
model_type = getattr(self._hf_config, "model_type", None)
543545

0 commit comments

Comments
 (0)