Remove strings from columns with only two strings in R

Question

I have a matrix like this:

r1 <- c("01","001","0001","01","100")
r2 <- c("10","001"