Tensorflow - Replay buffer add trajectory to batch shape mismatch

Question

I am currently trying to implement a categorical DQN following this tutorial: https://www.tensorflow.org/agents/tutorials/9_c51_tutorial

The following part is giving