I've never thought about this until now but it makes sense. When I talk to someone deemed 'lower' by society such as a cleaner (I don't on purpose, I respect people based on their values) and ask them a question or for directions, I'm fine. If I had to ask for instance a CEO of a company for directions I know already that it would be a harder conversation. Basically, minor social anxieties like this have a massive impact on a stutter.