How to create a custom gradient for vector graphics in Tensorflow

Question

I am trying to create a custom gradient to allow me to compute a loss function against vector graphics in the form of a PIL draw polygon

I created the loss function a