I have a pretty severe stutter so I'm always aware of it. I still care when talking to people at work (since it's somehow more urgent that I get my info across), but I find giving myself "permission" to stutter always helps some.