I have a reasonably large data set and would like to store it in a file rather than a RDBMS.
The main table in the data set is just over 1M rows, 30 columns and abou
sqlite is fast when you use transactions and don't commit too often. Using prepared statements with parameters speeds things up too. Sqlite doesn't have to reparse each sql statement when you use parameterized queries. An example: How do I get around the "'" problem in sqlite and c#?
I store 2 gigabyte in an sqlite db, it works very well. A big advantage of sqlite above a flat file is the possibility to index your data.