Replacing file or directory in local Git repo with upstream

Question

I am trying to use the git checkout upstream/master -- my-directory-here command to replace a directory in my local fork of the Huggingface transformers library