Agreed, I believe that the intention of communication is more important than the content. People who make jokes like that are, more often than not, just making a harmless joke. Completely unaware of a stutter.