Why can I send a UDP packet from A to B, but not from B to A?

Question

On machine A, it is very easy to call sendto() to send a UDP packet to machine B, which does a recvfrom() to get the data. However, when I reverse the roles, machine B is u