I actually have the opposite thing happen! The noise kind of scrambles my already "off" internal tempo. It's like a reset. It's often why I keep a headphone with music in when talking on the phone. It takes more concentration, but for some reason, it helps my stutter.