I would recommend adding try catch in functions which does memory allocation, deletion, calling another complex functions etc. Actually performance wise try catch adds a little bit of overhead.
But considering the merit of catching the unknown exceptions it is very helpful.
Good programming practices always recommend adding some kind of exception handling in your code unless you are an exceptional programmer.
I wonder why you are so concerned about small performance issue than the entire program being stuck with an exception.