If you saw them doing that to anyone else would you want to be friends with them or date them? I ask because I really think the main thing that makes it hard about having a stutter is believing that stuttering is simply something that is bad and you should be ashamed of it. If you believe that, then you have a reason to be nervous, to be quiet and they now have a reason to treat you like that. Even though I'm saying this, I know I don't fully believe it myself but I do think that's the difference between people that have a stutter, that are not as successfully social as they want vs people that have a stutter and just live life. One thinks they are failing every time they talk and the other thinks they just talk differently.