I have a file that looks like this:
2011-03-21 name001 line1 2011-03-21 name002 line2 2011-03-21 name003 line3 2011-03-22 name002 line4 2011-03-22 name001 li
sort < bar > foo uniq < foo > bar
bar now has no duplicated lines