Xfce/Thunar solution is basically the same as Gnome/Nautilus:
Simply type sftp://yourhost/ to address line in Thunar (You can get there by Ctrl + L)
(The authorization is identical to ssh/scp, i.e. with proper use of ~/.ssh/config, keys and ssh-agent, you can achieve decent ease and security: server alias + no passwords asked.)
