I use Windows Remote Desktop to connect to Amazon's HPC instances. I can run CUDA-based code there without problem. So, it is technically possible to access GPU's through a Windows Remote Desktop connection. I have no idea what Amazon is doing differently.