It's not always easy but I think its best to take people more for their intention rather than the effect. They are more then likely just attempting to be reassuring that it's not an issue for them in their interest in you. Better to see where it leads and they'll learn more about how you like your stutter handled by the people around you.