Because you're not _speaking_ (no other people involved in a communication). :) It's a common thing with a lot of stutterers. But if you think about it, it's not that odd: We're literally in a different situation, and we all know that stutter varies with the situation.