Python: CSV write by column rather than row

Question

I have a python script that generates a bunch of data in a while loop. I need to write this data to a CSV file, so it writes by column rather than row.

For example in

Answer 1

As an alternate streaming approach:

• dump each col into a file
• use python or unix paste command to rejoin on tab, csv, whatever.

Both steps should handle steaming just fine.

Pitfalls:

• if you have 1000s of columns, you might run into the unix file handle limit!