Randomness in Artificial Intelligence & Machine Learning

Question

This question came to my mind while working on 2 projects in AI and ML. What If I\'m building a model (e.g. Classification Neural Network,K-NN, .. etc) and this model uses s

Answer 1

Simple answer, yes, you randomize it and use statistics to show the accuracy. However, it's not sufficient to just average a handful of runs. You need, at a minimum, some notion of the variability as well. It's important to know whether "70%" accurate means "70% accurate for each of 100 runs" or "100% accurate once and 40% accurate once".

If you're just trying to play around a bit and convince yourself that some algorithm works, then you can just run it 30 or so times and look at the mean and standard deviation and call it a day. If you're going to convince anyone else that it works, you need to look into how to do more formal hypothesis testing.