CPAN::Mini is fine. By default it keeps only the latest version of a distribution, not every version as CPAN does.
You can also install CPAN::Mini::Webserver, which provides you with a web interface to your local cpan mirror - very handy if you are offline and still want to work with perl.