The thing is no one will remember him for his stutter if they rarely hear him stutter in the first place because his stutter is preventing him from ever opening his mouth. You can only be remembered if you're somehow extremely charismatic whilst having a stutter which is downright impossible due to the sadness and frustration that stuttering brings to most people.