For others still looking for answers you can go to /etc/sysconfig/jenkins in CentOS/RHEL or /etc/default/jenkins in Debian based distributions and change the JENKINS_PORT= variable to whatever port you want. Restart jenkins, and it should be running on your desired port.