问题
I want to ask if it is possible to multiply two tensors pairwise. So for example, I have tensor output from LSTM layer,
lstm=LSTM(128,return_sequences=True)(input)
output=some_function()(lstm)
some_function()
should do h1*h2,h2*h3....hn-1*hn
I found How do I take the squared difference of two Keras tensors? little helpful but since, I will have trainable paramter, I will have to make my own layer. Also, will some_function
layer interpret input dimension automatically as it will be hn-1
I am confused on how to deal with call()
回答1:
One possibility is to do two crop operations and then a multiplication. This does the trick!
import numpy as np
from keras.layers import Input, Lambda, Multiply, LSTM
from keras.models import Model
from keras.layers import add
batch_size = 1
nb_timesteps = 4
nb_features = 2
hidden_layer = 2
in1 = Input(shape=(nb_timesteps,nb_features))
lstm=LSTM(hidden_layer,return_sequences=True)(in1)
# Make two slices
factor1 = Lambda(lambda x: x[:, 0:nb_timesteps-1, :])(lstm)
factor2 = Lambda(lambda x: x[:, 1:nb_timesteps, :])(lstm)
# Multiply them
out = Multiply()([factor1,factor2])
# set the two outputs so we can see both results
model = Model(in1,[out,lstm])
a = np.arange(batch_size*nb_timesteps*nb_features).reshape([batch_size,nb_timesteps,nb_features])
prediction = model.predict(a)
out_, lstm_ = prediction[0], prediction[1]
for x in range(nb_timesteps-1):
assert all( out_[0,x] == lstm_[0,x]*lstm_[0,x+1])
来源:https://stackoverflow.com/questions/52941192/multiply-multiple-tensors-pairwise-keras