Let me analyze this:
- Retrieve information by key
- Persistant storage
- Do not want to write back the whole file when 1 value changes
- Should survive crashes
I think you want a database.
Edit: I think you are searching for the wrong thing. Search for a database that fits your requirements. And change some of your requirements, because I think it will be difficult to meet them all.