How to upload files to SFTP server using Parallel.ForEach loop for better perfomance

Question

I have tried Parallel.ForEach but some files uploaded with zero sizes. using normal for each loop working fine. but slow. files count is 4 million. size 4 MB each file.