I am using a library that consists almost entirely of templated classes and functions in header files, like this:
// foo.h template
Try using precompiled headers. I know GCC and MSVC support this feature. Usage is vender-specific, though.