I need a way to do key-value lookups across (potentially) hundreds of GB of data. Ideally something based on a distributed hashtable, that works nicely with Java. It should be
You might want to check out Hazelcast. It is distributed/partitioned, super lite, easy and free.
java.util.Map map = Hazelcast.getMap ("mymap"); map.put ("key1", "value1");
Regards,
-talip