RVM is not working over SSH.
At the command-line:
leifg@host:~$ which ruby /usr/local/rvm/rubies/ruby-1.9.2-p290/bin/ruby
Connected
Mentioned solutions work certainly fine, but mine was to run
source /usr/local/rvm/environments/@
at the start of the remote ssh call. Something like:
ssh -l "source /usr/local/rvm/environments/@ ; "