Speed up git add for large numbers of files and a filtered (clean=sha1sum) repository

Question

I have a git repository with a filter in .gitattributes as * filter=ls, so that each file is filtered before stored in the repo. The filter is conf