While I’m not in the camp that would make fun of him for his appearance (his existence is already a big enough joke), I think the logic comes from separating shaming people for their body versus attacking someone that you dislike and picking their body as the target. The key difference being in the reason for the body-centered insult; one is tied to hate for different looking people, whereas the other is tied to hating the person and finding something to attack about them.