Skip to content

Commit c924f65

Browse files
authored
Merge pull request #66 from vkuzo/20251002_refactor_2
clean up hf scripts
2 parents 9335326 + 97bd552 commit c924f65

File tree

5 files changed

+1
-5
lines changed

5 files changed

+1
-5
lines changed

hf_torchao_vllm/torchao_hf_script.py renamed to hf_torchao_vllm/quantize_hf_model_with_torchao.py

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2,10 +2,8 @@
22
# SPDX-License-Identifier: Apache-2.0
33

44
"""
5-
Script for quantizing LLM models with TorchAO.
5+
Script for quantizing HuggingFace models with TorchAO.
66
Supports various quantization configurations and model types.
7-
8-
Copy of Driss's https://www.internalfb.com/phabricator/paste/view/P1838316614
97
"""
108

119

hf_torchao_vllm/run_vllm.py renamed to hf_torchao_vllm/run_quantized_model_in_vllm.py

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,5 @@
11
# SPDX-License-Identifier: Apache-2.0
22

3-
# copied from Driss's https://www.internalfb.com/phabricator/paste/view/P1858050926
4-
53
import os
64

75
import random

0 commit comments

Comments
 (0)