How to manually specify color fill for two different grouping variables using ggplot?

Question

I would like to use ggplot2 to create a grouped bar plot, but I would like to be able to control the colors for the two different grouping variables separately. E.g., in the