The common mixing of RGB colors is very different from mixing colors for paintings, it\'s mixing of light instead mixing of pigments.
For example:
Bl
One way to do subtractive mixture of RGB colors is to first convert the RGB colors to spectral reflectance curves. The conversion is fairly simple, and once you've done it, you can do a true subtractive mixture of the reflectance curves, and then convert the result back to RGB. There is another similar question: stackoverflow.com/questions/10254022/, where this process is discussed in more detail.