How to tokenize a Malayalam word?

Question

ഇതുഒരുസ്ടലംമാണ്  

itu oru stalam anu

This is a Unicode string meaning this is a place

import nltk
nltk.w         


        

Answer 1

maybe the Viterbi algorithm could help?

This answer to another SO question (and the other high-vote answer) could help: https://stackoverflow.com/a/481773/583834