So I of course know that serving static files through Django will send you straight to hell but I am confused on how to use a custom url to mask the true location of the fil
The basic idea is to get your Django view to redirect to a secure URL that is served by your media server.
See this list of suggestions by Graham Dumpleton, author of mod_wsgi.