This has been my experience as well. When someone makes fun of you, your first instinct is to get defensive. However, almost every time I've explained the situation the person was taken back, extremely apologetic, and never did it again. Don't assume it's always malicious.