Keras network producing inverse predictions

Question

I have a timeseries dataset and I am trying to train a network so that it overfits (obviously, that\'s just the first step, I will then battle the overfitting).

Answer 1

You say that your network "just learned to negate the input value and slightly scale it down". I don't think so. It is very likely that all you are seeing is the network performing poorly, and just predicting the previous value (but scaled as you say). This issue is something I've seen again and again. Here is another example, and another, of this issue. Also, remember it is very easy to fool yourself by shifting the data by one. It is very likely you are simply shifting the poor prediction back in time and getting an overlap.