Different memory allocation on GTX 1080 ti, Tesla k80, Tesla v100 for the same pytorch model

Question

I have tried loading a distilbert model in pytorch over 3 different GPUs (GeForce GTX 1080 ti, tesla k80, tesla v100). According to the pytorch cuda profiler, the memory co