You may check out the stratey used by Apple iPod for storing it's multimedia content. There are folders in one level of depth and files with titles of same width. I believe that Apple guys invested a lot of time in testing their solution so it may bring some instant benefit to you.