Running EfficientNetB0 + some layers is extremely slow. I upgraded to Google Colab Pro and that cut the training time down to 2.5 hours/epoch...
Its 68 million traina