I decided to enable virtual hosts on my Apache server, and chose to make it port-based.
First thing I did, of course, was RTM. I followed the instructions found her
In my case, the problem was fixed by running the following command:
apt-get install libapache2-mod-php