I need a tool to find duplicates or similar blocks of text in a singular text file or set of text files

Question

I want to automate moving duplicate or similar C code into functions.

This must work under Linux.

Answer 1

You'll want to take a look at Simian. It's free for noncommercial projects. Try something like:

# Find all C source files and identify similarities/duplicate code.
simian -includes=**/*.c -excludes=**/*_test.c