shelve

I have a large Python dictionary of vectors (150k vectors, 10k dimensions each) of float numbers that can't be loaded into memory, so I have to use one of the two methods for storing this on disk and retrieving specific vectors when appropriate. The vectors will be created and stored once, but might be read many (thousands of) times -- so it is really important to have efficient reading. After some tests with shelve module, I tend to believe that sqlite will be a better option for this kind of task, but before I start writing code I would like to hear some more opinions on this... For example,

I am hoping for a little advice on shelves/databases in Python. Problem: I have a database created on the mac, that I want to use on windows 7. I use Python 3.2, MacOS 10.7, and win 7. When I open and save my shelve on the mac all is good and well. I get a file with a ".db" extension. On my windows-python it is not recognized. I can however create a new db on the pc and get files with ".bak, dat, .dir" extensions. I am guessing that the python on the pc does not have the same underlying database that my mac-python uses? I am not sure which is the correct approach here, but maybe I could:

I need to download a shelveset from TFS to a local folder. Is there any tools or add-in for Visual studio 2010 to download shelveset If you just need to get the files from the shelveset to your local folder , this is a normal process and called Unshelve . It downloads the files to your local folder. For example, before unshelve you had the following in your local folder : File 1 File 2 The shelveset has: File 1 (Modified) File 3 (Created) After unshelve there will be: File 1 (Updated) File 2 File 3 (Added) If you need to have only the files from the shelveset in your workspace folder without

I have some changed files I don't want to commit (e.g. web.config). Before I pull and update to new changesets, I have to shelve them. After the pull & update, I have to unshelve them. I'm currently using TortoiseHG. Is there any extension which can do this automatically? Christian Specht I'd suggest something else: instead of always shelving and unshelving, you could use two different config files: one which is part of the repository and contains dummy/example data, and another one which each user really uses locally, which is ignored by Mercurial. Check out this answer for a more detailed

Why shelve raise an error if I try to open a file just created by shelve? import shelve info_file_name = "/Users/bacon/myproject/temp/test.info" info_file = shelve.open(info_file_name) info_file['ok'] = 'wass' info_file.close() info_file = shelve.open(info_file_name) # raise exception db type could not be determined.. info_file.close() I'm running python 2.5 in case is relevant The precise error is raising is: db type could not be determined its raised by anydbm.py open method. I know it;s using gdbm. I checked on the whichdb.py file, and it tries to identify gdbm files with this # Read the