User Tools

Site Tools


singlish_tokenization

Singlish Tokenization

Singlish tends to follow the standard tokenization of English. The only unique cases are particles in Singlish. These particles should be considered one token.

singlish_tokenization.txt · Last modified: 2018/09/11 10:02 (external edit)