I could be mistaken but your manager isn't legally allowed to interrogate you about your stutter, since I believe the ADA prohibits employers from asking about the nature or severity of a disability. They can only ask if you can perform the duties of the job with or without reasonable accommodation.