How to find cost function if ReLU output is very large?

Question

I am trying to build a simple feedforward neural network from scratch for the MNIST digit database. I am using ReLU activations for the hidden layers.

The output laye