berkeley-db-je

I plan to insert a large number of unique keys ( ~3E9 ) in a BerkeleyDB JE database. The keys will have a fixed length ( ~10 bytes ) but the values will have a variable length. The database won't be transactional. What parameters would you suggest for the EnvironmentConfig and the DatabaseConfig for optimizing the size and the speed of my database ? Many thanks, Pierre OK, I found the solution using the utility com.sleepycat.je.util.DbCacheSize packaged into berkeleyDB-JE java -cp je-4.0.103.jar com.sleepycat.je.util.DbCacheSize -records 3000000000 -key 8 Inputs: records=3000000000 keySize=8

I need a disk backed Map structure to use in a Java app. It must have the following criteria: Capable of storing millions of records (even billions) Fast lookup - the majority of operations on the Map will simply to see if a key already exists. This, and 1 above are the most important criteria. There should be an effective in memory caching mechanism for frequently used keys. Persistent, but does not need to be transactional, can live with some failure. i.e. happy to synch with disk periodically, and does not need to be transactional. Capable of storing simple primitive types - but I don't