This kind of stuff stopped bothering me a LONG time ago, personally. I just chuckle when people say something like this now. And hey, if they're being assholes and not just saying it in a light-hearted way, you can enjoy seeing the shame on their face that usually comes after you respond. Don't let it get to you too much.