file based merge sort on large datasets in Java

Question

given large datasets that don\'t fit in memory, is there any library or api to perform sort in Java? the implementation would possibly be similar to linux utility sort.

Answer 1

The most common way to handle large datasets is in memory (you can buy a server with 1 TB these days) or in a database.

If you are not going to use a database (or buy more memory) you can write it yourself fair easily.

There are libraries which may help which perform Map-Reduce functions but they may add more complexity than they save.