Many Java desktop apps (these times: things like Eclipse) have bad GUI responsiveness, probably due to the high memory consumption and the fact that classloader can do lots of IO.
It's improving but was worse few years ago.
Many (most) people like to do generalizations so they say "Java is slow" because they perceive the apps are slow when they interact with them.