Handling very large data with mysql

Question

Sorry for the long post!

I have a database containing ~30 tables (InnoDB engine). Only two of these tables, namely, \"transaction\" and \"shift\" are quite large (th

Answer 1

When collecting billions of rows, it is better (when possible) to consolidate, process, summarize, whatever, the data before storing. Keep the raw data in a file if you think you need to get back to it.

Doing that will eliminate most of your questions and concerns, plus speed up the processing.