I barely stuttered as far as I remember but a lot of times of think we don't notice when we have light stutters.  They react as much as I do.  Usually i think its more their impressed but no one really cares for more than a minute because they'll go right back to thinking about themselves as we all do so why bother caring or worrying?  Which ironically makes it easier.