Using an arbitrary Windows machine (2000/XP or later), I can
install Eclipse CDT to a USB drive
move that USB drive onto a different Windows
Eclipse is apparently designed to be what Microsoft calls an XCOPY deployment...meaning that it doesn't require any special entries in the Windows Registry (or any other "installation identity" on the target machine) in order to work properly.
Visual Studio is most decidedly not designed like this. It makes extensive modifications to the registry during installation, and those entries (and any other resources like special folder locations) will be missing on any other computer.
So you might be able to install Visual Studio on a thumb drive, but some artifacts of the installation will be put on the C: drive, and you will only be able to use the thumb drive with that machine.