If you are really looking for inverted quotes, use this:
System.out.println('\u201C' + s + '\u201D');
It'll output “hi”, not "hi".
You need to have a font installed, though, that supports this, otherwise you might get a box or something instead. Most Windows fonts do.
