There are numerous models you might be able to use. But I think the most recently being used model for such sequence learning problems, are bidirectional RNNs( like Bidirectional LSTM), you can get a hint from here
But be advised, Bidirectional RNNs are very expensive to train. Depending on your problem to solve, I highly advice to use some pre-trained model.
Good luck!
