Am I the only one who thinks this?

Am I the only one who thinks this? Am i the only one who thinks that everyone I talk to is just really impatient? When I talk to people and stutter I feel like the other person is annoyed and wants me to hurry up, which obviously isn't always the case and I know some people are really patient but everytime I stutter it just feels that way, then I try to rush myself to speak. Am I the only one?