After some bad experiences (that we all had) it's pretty normal to isolate a bit. You start to associate a block as something wrong, as something that's not normal. Stuttering is mostly a fight against ourselves, most people don't really care if we stammer, but WE do and that's the main issue. I've always been a kind of solitary guy, i guess it's because of my stutter too, or at least it contributed a bit.