Issues saving and building when subclassing class tf.keras.Model for Reinforcement Learning

Question

"ValueError: Model cannot be saved because the input shapes have not been set. Usually, input shapes are automatically determ