I have a tensor holding a batch of permutations of the integers 0 to time-1 which e.g. has the shape
0
time-1
[batch,time]
N