Maybe because around strangers you subconsciously try harder at implementing fluency shaping strategies more than around family, where your guard is down? Is there any unresolved tension between yourself and certain family members? When my dad was alive I really struggled to talk around him because of unresolved anger towards him for the years of abuse when I was growing up.