I’ve had similar things to you. Generally, the more comfortable I am around a person, the less I stutter, with one exception. When I’m speaking to my dad, I always stutter more than usual. None of the usual stutter flare ups are there ( I’m not stressed or nervous because I’m talking to him), but for some reason, my speech is way worse.