How can I speed up fetching the results after running an sqlite query?

Question

As an answer on my question: Is it normal that sqlite.fetchall() is so slow? it seems that fetch-all and fetch-one can be incredibly slow for sqlite.

As I mentioned

Answer 1

From reading this question, it sounds like you could benefit from using the APSW sqlite module. Somehow you may be victim of your sqlite module causing your query to be executed in some less performant manner.

I was curious so I tried using apsw myself. It wasn't too complicated. Why don't you give it a try?

To install it I had to:

1. Extract the latest version.

2. Have the installation package fetch the latest sqlite amalgamation.

   python setup.py fetch --sqlite
   

3. Build and install.

   sudo python setup.py install
   

4. Use it in place of the other sqlite module.

   import apsw
   <...>
   conn = apsw.Connection('foo.db')