Parallellizing, joining and error checking bash commands?

Question

Consider the following shell script:

#!/bin/bash

set -e

foo
bar
baz

fini

This will execute the subcommands foo, bar