Text Prediction with word and character LSTM

Question

I\'m trying to implement an LSTM with both character and word embeddings as shown here, except my problem is not NER, just simple text prediction. Right now I\'m getting thi