I would like to build a one layer LSTM model with embeddings for my categorical features. I currently have numerical features and a few categorical features, such as Location, w
One other solution I could think of is you could as well concat the numerical(after normalizing) and categorical features together even before you feed it to the lstm.
During the backprop alow the gradients to flow only in the embedding layer since by default the gradient will flow in both branches.