I tested it on a Windows machine with gvim and could reproduce your problem, here is a workaround that worked for me adding next commands to vimrc (I got it with :e $MYVIMRC):
set splitright
function MySplit()
vsplit
execute "normal \\"
endfunction
nmap v :call MySplit()