My ZF2 application seems to be extremely slow when more than 3 users are using it at the same time.
I profile my code with xdebug and webgrind and non of my function
the ZF2 classmap generator will give you a big boost if you have a large project:
http://framework.zend.com/manual/2.0/en/modules/zend.loader.classmap-generator.html
Alternatively if you are using composer (you should do) then you can use composer to generate the classmap for all your modules and dependdencies too which is even better:
php composer.phar install --optimize-autoloader
php composer.phar update --optimize-autoloader