The social acceptability of telling a guy ''he's punching above his weight'' when with a prettier woman is abhorrent

People almost shame normal looking men who have pretty girlfriends as if they have no right to be with these women, despite these women also choosing to be with these guys. Its damaging to any persons confidence saying such things but men are expected to laugh at it or be okay with such comments, its basically telling you you're not attractive as a person yet is seen as acceptable to say it to these men and its never said in a complimentary fashion even if the person saying it is trying to ''say it humorously'' and its dismissing the character and personality of the guy in question too.