I think it's precisely because music provides an external rhythm that we can latch onto (in addition to being a different speech context outside of communication, which reduces the anxiety necessary to trigger stuttering and uses other neural circuits).