Skip to content

Commit 441cf4b

Browse files
committed
Merge: [BERT/PyT] set default bin size to 64 for phase2
2 parents a684cf0 + a0781f8 commit 441cf4b

File tree

1 file changed

+1
-1
lines changed
  • PyTorch/LanguageModeling/BERT

1 file changed

+1
-1
lines changed

PyTorch/LanguageModeling/BERT/run.sub

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -41,7 +41,7 @@ STEPS_THIS_RUN=${STEPS_THIS_RUN:-"none"}
4141
GPUS=${GPUS:-"8"}
4242
# The bin size for binned LDDL data loading. 'none' or an integer that divides
4343
# 128 (for Phase1) or 512 (for Phase2).
44-
BIN_SIZE=${BIN_SIZE:-"none"}
44+
BIN_SIZE=${BIN_SIZE:-"64"}
4545
# Number of parquet shards per each LDDL data loader worker process. 'none' or
4646
# an integer.
4747
NUM_SHARDS_PER_WORKER=${NUM_SHARDS_PER_WORKER:-"none"}

0 commit comments

Comments
 (0)