Inconsistency in loss on SAME data for train and validation modes tensorflow

Question

I\'m implementing a semantic segmentation model with images. As a good practice I tested my training pipeline with just one image and tried to over-fit that image. To my sur