It’s because you’re anticipating the stuttering and fearing it. I saw somewhere that fear just worsens the stutter.