What is the best way to achieve speedy inserts of large amounts of data in MySQL?

Question

I have written a program in C to parse large XML files and then create files with insert statements. Some other process would ingest the files into a MySQL database. This

Answer 1

1. Make sure you use a transaction.

Transactions eliminate the

INSERT, SYNC-TO-DISK

repetition phase and instead all the disk IO is performed when you COMMIT the transaction.

2. Make sure to utilize connection compression

Raw text + GZip compressed stream ~= as much as 90% bandwidth saving in some cases.

3. Utilise the parallel insert notation where possible

INSERT INTO TableName(Col1,Col2) VALUES (1,1),(1,2),(1,3) 

( Less text to send, shorter action )