How to make R gtable fit the image

Question

I am developing an extension of the gridExtra R package to have tables where labels are not text but other grobs. I am trying to arrange two gtable