With a really empty folder, the answer is no.
It's not possible because of how Git technically handles data.
BUT, if you're OK to accept some compromise: just create some file, like .gitignore or whatever inside the directory you want be seen, and you're done. README file can be a solution, but I would personnally not use that name because that would create confusion with people thinking there's content inside those files.
See How can I add an empty directory to a Git repository? for a very similar question.