You become uncomfortable because it's like a mirror and you (subconciously) worry if it looks like that when you speak too. There are people who don't stutter that get uncomfortable when listening to someone who stutters, but from my experience the majority of people doesn't once they know you stutter.