Yes, you can put per repository ignore patterns in .git/info/exclude in each repository.
(Note, this only affects what is ignored in each repository, it won't affect files that you actively place under source control and the push. I'm not completely clear on your desired use case.)