Skip to content

Preserve whitespace in the Korean tokenizer#13974

Open
Incheonkirin wants to merge 2 commits into
explosion:masterfrom
Incheonkirin:fix/ko-tokenizer-whitespace
Open

Preserve whitespace in the Korean tokenizer#13974
Incheonkirin wants to merge 2 commits into
explosion:masterfrom
Incheonkirin:fix/ko-tokenizer-whitespace

Commits

Commits on Jun 6, 2026