I just say "that's not helping". If they aren't being mean they'll take it on board and realise it was a mistake to say it. If they are purposely being mean. You are just highlighting to them that they are in the wrong in the situation.