Training a Neural Network with 6 images per subject

Question

I am trying to apply deep learning to Cross eyed Database which has 120 subjects with 8 images in NIR. I am trying to apply deep learning with little success. I used VGG16,