It's the same for me, but when the flow is interrupted because the other party is talking, if they are not mindful and inclusive simply because of their nature and style of talking, it's very hard to take back control and continue my train of thought. When they finish talking, I can easily follow up on what they've just said, but waiting too much would cause the silence to be too deep and I would just focus too much on the awkwardness of the situation, causing me to stutter. The main thing for me that's causing stuttering, is being afraid of others' opinions. The more I focus on the social hierarchy, the more I will stutter. If I'm talking to someone "higher up", like older folks or respected professionals who could judge me rightfully for what I say, I always stutter. And it even happens while talking to my Dad. If I feel, that the other person is disturbed by my presence or I'm just causing inconvenience for them (could be any reason), then I will be nervous and stutter. I might have some kind of compulsion to conform lurking in the shadows causing my life-long stuttering and I just hate it.