The msdn documentation about order preservation in PLINQ states the following about ForAll().
Does this mean that ordered execution of the ForAll method is never guaranteed?
Yes - order is not guaranteed.
The parallelisation means that the work is allocated to different threads and their separate outputs are then later combined.
If you need to order the output then don't use PLinq - or add some later step to put the ordering back in.
Also, if you are accessing objects like a StringBuilder from within the plinq execution, then please ensure that those objects are threadsafe - and also be aware that this thread safety may in fact make the plinq slower than the non-parallel linq.