conv-neural-network

Keras/Tensorflow - fourier pointwise multiplication implementation of conv2d running 4x slower than spatial convolution

自作多情 提交于 2020-08-26 13:48:38
问题 According to the convolution theorem, convolution changes to pointwise multiplication in the fourier domain, and the overheads of taking the fourier transform have been shown to be overshadowed by the gain due to conversion of convolution operation to pointwise multiplication operation in many previous works like the following - https://arxiv.org/abs/1312.5851. To replicate this, I was trying to replace the keras.layers.Conv2D() layer by a custom layer that accepts the rfft of input data (I

Tensorflow: loss decreasing, but accuracy stable

 ̄綄美尐妖づ 提交于 2020-08-22 03:25:00
问题 My team is training a CNN in Tensorflow for binary classification of damaged/acceptable parts. We created our code by modifying the cifar10 example code. In my prior experience with Neural Networks, I always trained until the loss was very close to 0 (well below 1). However, we are now evaluating our model with a validation set during training (on a separate GPU), and it seems like the precision stopped increasing after about 6.7k steps, while the loss is still dropping steadily after over