It was in bad taste, but if this is the extent of the managers misdeeds, contacting HR is a pretty severe reaction. Over-reaction, if I'm being honest. Talk to the manager. Let them know you would appreciate your speech impediment not being a punch line. I like to try to give people the benefit of the doubt. Maybe this is their first encounter with a person with a stutter.