I have a script that generates a log file with ANSI color codes in them like so:
[2012-05-14 18:00:02] ^[[0mINF: -- Starting update script --^[[0m [2012-05-1
I'm not sure about vim, but if you're just viewing a log file (ie you don't need to be able to edit) you could use less:
less -R