Data Deduplication algorithm for large files(everything from 10KB to 17Gigs)

Question

I wanna make a data deduplication program/script(something like git but for large files) for my NAS.

I would like some recommendations for things like which language