You wouldn't look like the idiot, they would. If someone rudely tries to guess what I'm saying I will either continue my sentence through their interruption, even if they guess correctly. Or I'll stop, stare at them until they shut up. And then continue. Eventually they'll figure it out.