That's a very common thing among people who stutter. The environment influences our mood which influences our nervous system which ultimately plays out our stutter.