Skip to content
This repository was archived by the owner on May 1, 2025. It is now read-only.

Commit 5cecb37

Browse files
authored
Update README.md
1 parent c67463d commit 5cecb37

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -129,7 +129,7 @@ There are a few notable arguments that need to be considered:
129129
- ``model_name``: the name of the model, currently support ``codet5`` and ``causal-lm``.
130130
- ``model_type``: type of model for each model name, e.g. ``base``, ``codegen-350M-mono``, ``j-6B``, etc.
131131
- ``load_in_8bit``: inherit the ``load_in_8bit" feature from [Huggingface Quantization](https://huggingface.co/docs/transformers/main/main_classes/quantization).
132-
- ``weight_sharding``: our advance feature that leverate [HuggingFace Sharded Checkpoint](https://huggingface.co/docs/accelerate/v0.19.0/en/package_reference/big_modeling#accelerate.load_checkpoint_and_dispatch) to split a large model in several smaller shards in different GPUs. Please consider using this if you are dealing with large models.
132+
- ``weight_sharding``: our advance feature that leverages [HuggingFace Sharded Checkpoint](https://huggingface.co/docs/accelerate/v0.19.0/en/package_reference/big_modeling#accelerate.load_checkpoint_and_dispatch) to split a large model in several smaller shards in different GPUs. Please consider using this if you are dealing with large models.
133133

134134
### Model Zoo
135135
You might want to view all of the supported models. To do this, you can use the ``model_zoo()``:

0 commit comments

Comments
 (0)