I combined both components by changing some code in ImageViewZoom. The change was for the events to return a value if they were consumed by the ImageViewTouch. If so, than the event should not be passed to the gallery. If the event is not consumed by the ImageView, than the gallery should consume it (if it can).
There are still some small issues, but it's functional. Hopefully other people in the community can help.
Here's the fork on github: https://github.com/kilaka/ImageViewZoom
Thanks.