I've found the best response (and maybe the smart-ass response) to this is to politely and calmly say "I have a speech impediment" and just let the silence linger. Let them sit in that. Normally, they end up apologizing. I'm not one to make people feel stupid on purpose, but sometimes letting people sit in their own rudeness brings awareness that will actually stick with them.