Why does grep match all lines for the pattern “\'”

Question

In this SO question there is something that I cannot explain:

grep \"\\\'\" input_file

matches all lines in the given file. Does \\\'

Answer 1

\ is an escape character. This mean the the ' should considered as text to search for, and not as a control character.