We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent fe51fe6 commit 160785cCopy full SHA for 160785c
src/TextMate/Tokenizer.php
@@ -45,7 +45,7 @@ public function tokenize(string $text): array
45
contentNameScopesList: $scopeList,
46
);
47
48
- $lines = array_values(preg_split("/\R/", $text));
+ $lines = array_values(preg_split("/\R/u", $text));
49
$tokens = [];
50
51
foreach ($lines as $index => $line) {
0 commit comments