Skip to content

Commit 99b3045

Browse files
committed
remove whitespace changes
1 parent 47484a1 commit 99b3045

File tree

1 file changed

+0
-3
lines changed

1 file changed

+0
-3
lines changed

+bert/+tokenizer/+internal/WordPieceTokenizer.m

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -35,9 +35,6 @@
3535
this.Unk = nvp.UnknownToken;
3636
this.MaxChar = nvp.MaxTokenLength;
3737
this.Vocab = this.parseVocab(vocab);
38-
39-
40-
4138
end
4239

4340
function tokens = tokenize(this,text)

0 commit comments

Comments
 (0)