I am in the process of moving a TFS 2010 installation from one machine to another.
I found that is possible remap identities using TFSConfig Identities /change
TFSConfig Identities /change
Don't clean them up. They are inactive so think of them as tombstones. If you get rid of them, you may experience dangling users (in Access Control Entries or File History for example).