Technically, it would depend on the relational database management system you are using. I think the performance hit would be microseconds. If you are absolutely trying to squeeze the last bit of performace out of your system, I would say don't use them.
I personally use it all the time.