Working with SSIM loss function in tensorflow for RGB images

Question

I want to use SSIM metric as my loss function for the model I\'m working on in tensorflow. SSIM should measure the similarity between my re

Answer 1

SSIM is designed to only measure the difference between two luminance signals. The RGB images are converted to greyscale before measuring similarity. If that was fed back into the loss function, it wouldn't know if the image was losing color saturation because it wouldn't show up in the error metric. That's just a theory.