Azure Load Balancer - cannot reach port unless it is open in Network Security Group

Question

Load Balancer is configured to redirect TCP requests on the front port 80 to backend port 8080. That worked fine till I removed "Allow-Port-8080" rule from the Net