Of course! Ah yes, I feel almost this exact same way where the stutter only appears around certain triggers. For me, I speak "stutter-lessly" to people who I have from the very start never stuttered in front of, and can stutter horribly in front of people my mind can deem intimidating. What this proves, in my thought, is that there is nothing wrong with us, and we know the problem at hand. The key is to try our best to reduce the panic near these triggers of stuttering, so that we can prevent it to a good degree.