Run a hadoop cluster on docker containers

Question

I want to run a multi-node hadoop cluster, with each node inside a docker container on a different host. This image - https://github.com/sequenceiq/hadoop-docker works well

Answer 1

The people from sequenceiq have created a new project called cloud-break that is designed to work with different cloud providers and create hadoop clusters on them easily. You just have to enter your credentials and then it works the same for all providers, as far as I can see.

So for ec2, this will now probably be the easiest solution(especially because of a nice GUI):

https://github.com/sequenceiq/cloudbreak-deployer