I am writing a server program which is used to run unit tests of an API (displaying lots of information and providing web access to control / monitor the whole thing)...<
Probably not. The Java classloader doesn't really support run-time loading; even the available classloaders are hacks that use a proxy object.