Outputting parameterized SQL files into a giant text file

Question

So my use-case is this - I need to parse 800,000 files in an S3 bucket, extract the data I need, and then read it into a SQLite database.

I tried looping over them an