I have a Viewbox:
Setting the x:Shared attribute of the ViewBox to false as suggested by @ASh will indeed work but why don't you just include the ViewBox in the ControlTemplate like this?
ViewBox
false
ControlTemplate
A template is a template and a control instance is an instance.