I installed Neo4j on Ubuntu 12.04 using these instructions: http://www.neo4j.org/download/linux
wget -O - http://debian.neo4j.org/neotechnology.gpg.key | apt
Just check once the current value from below command ulimit -n and ulimit -a
And you can edit the value on path below /etc/security/limit.conf