I have a dataframe like this:
cluster org time 1 a 8 1 a 6 2 h 34 1 c 23 2 d 74
I would simply do this, which literally follows what your desired logic was:
df.groupby(['org']).mean().groupby(['cluster']).mean()