Let me first say that being able to take 17 million records from a flat file, pushing to a DB on a remote box and having it take 7 minutes is amazing. SSIS truly is fantasti
Flat File Source --> Aggregate (Group By Columns you want unique) --> Flat File Destination