If you don't have a problem with splitting it up in two annotations, you could just do:
annotate("text", x = 4, y = 25, label = "This should be bold",
colour = "red", fontface =2)+
annotate("text", x = 4, y = 24, label = "and this not",
colour = "red")