The problem is that that Android will only animate the Image of the Button to the new place.
This means the onClick Area stays at the old place. You also need to change the position of the button at the end of the Animation to move the whole button to the new place and not only its View.