Why does adding the `--display_step 2` argument significantly slow down Mozilla DeepSpeech training time?

Question

I am training Mozilla DeepSpeech on the Common Voice data set on Ubuntu 16.04 LTS x64 with 4 Nvidia GeForce GTX 1080 by executing the command:

./DeepSpeech.py