I (sort of) already know the answer to this question. But I figured it is one that gets asked so frequently on the R Users list, that there should be one solid good answer.
In Python you make a multiline comment with 3x single quotes before and after the comments. I tried this in R and it seems to work also.
Eg.
''' This is a comment This is a second comment '''