Each assembly is loaded into the main domain as well. Since you use Assembly instance, your main domain loads this assembly in order to be able to analyze all the types in it.
If you want to prevent loading assembly in both domains - use AppDomain.CreateInstance method.