I have a bit more sever stutter then yours but sometimes I won't feel stressed or anxious at all but my stutter will still be bad. I still find doing anxiety reducing exercises like meditating a little each day. Not in an overly hippy way or anything but just sitting down eyes closed and breathing slowly for ten minutes a day has a big accumulative affect on my stutter.