My experience is just like this. Once in one I have been fine. If the person truly cares about you they won't care about the stutter. Its meeting new people and striking up conversations is the hard part.