I believe in self-disclosure. Depending on the severity of your stutter, it might be something you can keep in your back pocket as a lifeline. Saying "Please be patient, I have a stutter." can alleviate your anxiety while giving the person on the other end an explanation for pauses, blocks, or sound repetitions. If you use this method and someone still hangs up on you, call them back and tell them to fuck off.