The only thing I can think of is that virtual methods are a little bit slower to call than non-virtual methods, because the call has to go through the virtual method table.
However, this is a bad reason to screw up your design. If you need more performance, use a faster server.