Is a Neural network with 2 input nodes, 2 hidden nodes and an output supposed to be able to solve the XOR problem provided there is no bias? Or can it get stuck?
Leave the bias in. It doesn't see the values of your inputs.
In terms of a one-to-one analogy, I like to think of the bias as the offsetting c
-value in the straight line equation: y = mx + c
; it adds an independent degree of freedom to your system that is not influenced by the inputs to your network.