Address it with the person that you're speaking to. In the moment and on the spot. What should you say in the moment? That'll be situationally dependent. But speak your mind. "Is my stutter making you uncomfortable?". "You seem uncomfortable, is it because of my stutter? I'm happy to discuss it if you have questions." Again without being a part of the conversation I don't know what the proper way to address the issue is with your peers. But I do recommend addressing it. And if it's people that you see regularly maybe you can circle back to them and ask them.