Maybe it’s similar to how people are generally more confident in groups than alone. A person complimenting a strangers shoes on the street will find it much easier if he was with friends than if he wasn’t. Likewise, your self worth is made to appear greater to you when you are with someone you’re comfortable with, and, with most people who stutter, confidence is one of main factors that make us stutter.