I am the same exact. I also have a mild stutter and it only comes out when I am put on the spot to talk to random people or when I really anticipate to say something, I start to stutter as well. But by myself or with close friends I dont stutter at all which is so weird to me.