If I create some file using Path.GetTempPath() - does it automatically get deleted at some stage, or is it up to me to delete it?
Basically if your application does not delete a file it will still be there until your application removes it and you should manage files your app creates based on that idea.
That said, once the file is closed you must always allow for the fact that it may not be there next time you want it and that you may need to recreate it. For example, Windows has a "disk cleanup tool" which may be run when space gets low, when directed by a user, or on a schedule...