Flip it on them! I say, "no, I just have a speech problem" and then they usually are super apologetic and feel like a dick. It's a good lesson for them to learn.