I recently had a play around with Hadoop and was impressed with it\'s scheduling, management, and reporting of MapReduce jobs. It appears to make the distribution and execut
ProActive Scheduler seems to fit your requirements, especially the complex workflows you mentionned with tasks coordination.
It is open source and Java based. You can use it to run anything, Hadoop jobs, scripts, Java code,...