I have implemented a suffix tree in Python to make full-text-searchs, and it\'s working really well. But there\'s a problem: the indexed text can be very bi
If pickle
is already working for you, you may want to take a look at ZODB which adds some functionality on top of pickle
. Looking at the documentation, I saw this paragraph that looks to address the size concerns you're having:
The database moves objects freely between memory and storage. If an object has not been used in a while, it may be released and its contents loaded from storage the next time it is used.