Removing duplicates while reading multiple text files using Python

Question

I am trying to:

• read multiple text files
• keep only header of first file
• account for formatting issues (e.g. special characters)
• merge the