transform: translate(0, 0); works for IE11. Thanks @tomekwi.
My button text that was jumping was inside a ::before pseudo element, so I used the following to solve the issue:
.myButton:active::before {
transform: translate(0, 0);
}
But in the end maybe it's better to just let it jump in IE.