how to ignore collision on player object in unity multiplayer(2 player) using mirror or unet(depreciated)

Question

HI i am having a blockbreaker multiplayer game with 2 players spawns with each having 1 ball & 1 paddle. I want the ball of player 1 should not hit the paddle of player