问题
I am trying to process so text files with awk using the parallel command as a shell script, but haven't been able to get it to output each job to a different file
If i try:
seq 10 | parallel awk \''{ if ( $5 > 0.4 ) print $2}'\' file{}.txt > file{}.out
It outputs to the file file{}.out instead of file1.out, file2.out, etc.
The tutorial and man pages also suggest that I could use --files, but it just prints to stdout:
seq 10 | parallel awk \''{ if ( $5 > 0.4 ) print $2}'\' file{}.txt --files file{}.out
回答1:
It turns out I needed to quote out the redirect, because it was being processed outside of parallel:
seq 10 | parallel awk \''{...}'\' file{}.txt ">" file{}.out
回答2:
Another way is to introduce the entire parallel command inside double quotes:
seq 10 | parallel " awk command > file{}.out "
Although, sometimes is useful redirect the output to file and also to stdout. You can achieve that using tee. In this case, the command to be used could be:
seq 10 | parallel " awk command | tee file{}.out "
回答3:
As I was parallelizing a script that has no pipes support, the solutions here were not valid for me, so I opened a new thread here that solves the issue.
I hope it will help some others arriving here.
来源：https://stackoverflow.com/questions/22187834/gnu-parallel-output-each-job-to-a-different-file