Hopefully there are some WCF wizards out there that can spot my mistake here.
I am trying to set up a global error handler via an IErrorHandler based behaviorExtens
Don't forget to set the ContentType of the response as well:
rmp.Headers[HttpResponseHeader.ContentType] = "application/json";