Flutter How to detect pointer swiping along multiple containers

Question

Lets say I have two containers placed differently below here. User starts swiping continuously from the bottom end of the arrow until the top. I want to be able to detect th