I get this too. When I tell people I stutter sometimes they're like, "huh, you do?" Because I can talk easier around then but around family I stutter the worst. I think it's called covert stuttering