Deep Learning Model Trained to identify balls is identifying lemons as balls?

Question

I trained a deep learning model using the Mask RCNN implementation of Matterport github repository

The model detects TT balls perfectly in images. The problem comes w