If you put your content in a asp:Panel you can use the DefaultButton Property to set a different button as the default so your image button wont be clicked.
In this example the btn_Test2 will be clicked when you hit enter where normally btn_Test1 would be clicked