My master branch layout is like this:
/ <-- top level
/client <-- desktop client source files
/server
Unfortunately, git provides no way to do this. Instead, the 'git way' is to have two repositories -- client and server, and clone the one(s) you need.