Look more closely at an example such as the parallel distance from the Rcpp Gallery.
It does not use NumericMatrix but rather RMatrix<double>. I would do the same here, and have generally advocated not to rely on contact with R types while running parallel segments.