Using an arbitrary Windows machine (2000/XP or later), I can
install Eclipse CDT to a USB drive
move that USB drive onto a different Windows
Maybe you could install VS Express in a VM running from the USB drive using Portable VirtualBox or VMPlayer. Not the best performance but its usable for not too big projects or learning.