use VNTokenizer for Vietnamese
Vietnamese separates syllables with spaces, so you have to use a tokenizer to find the words. As the beta version of Readlang currently stands, each syllable is considered a word and multi-syllabic words are considered phrases, which Readlang treats quite differently.
1
vote
Nathan Glenn
shared this idea