Gensim: TypeError: doc2bow expects an array of unicode tokens on input, not a single string

Question

I am starting with some python task, I am facing a problem while using gensim. I am trying to load files from my disk and process them (split them and lowercase() them)

Answer 1

Hello everyone i ran into the same problem. This is what worked for me

    #Tokenize the sentence into words
    tokens = [word for word in sentence.split()]

    #Create dictionary
    dictionary = corpora.Dictionary([tokens])
    print(dictionary)