I would ignore them. If they say it again, explain that's its a speech impediment that you have zero control over. If they keep bothering you after that, they're assholes.