I am trying to install the gnu arm toolchain for ubuntu. I first downloaded the tar from CodeSourcery. However when I go into the bin folder, I cannot run any of the binarie
You have installed a toolchain which was compiled for i686 on a box which is running an x86_64 userland.
Use an i686 VM.