I have this config which works and redirects the following errors correctly
Try defaultPath="~/Error/ApplicationError" with ~.
defaultPath="~/Error/ApplicationError"