Here is a basic overview of the release history. PHP 5 was a big change.
I won't go into huge detail on the differences though since PHP 4 is deprecated. Stick with PHP 5 & MySQL 5. I'd be surprised if a webhost didn't offer PHP 5 as well as 4. 4 should only be used with legacy code and should never be used for new development.
