I\'m having trouble getting my model to converge. Based on a paper I found that uses SVM as the top of the ResNet, but it\'s just not working. The RandomFourierTransform I r