I\'m looking to fit a plane to a set of ~ 6-10k 3D points. I\'m looking to do this as fast as possible, and accuracy is not the highest concern (frankly the plane can be off
In computer vision a standard way is to use RANSAC or MSAC, in your case;
http://en.wikipedia.org/wiki/RANSAC