You need to advocate for yourself. Part of that is telling people when you're not ok with a behavior, stuttering related or otherwise. Sounds like he wants to be friendly with you anyway. I would say "hey man, mimicking my stutter isn't funny and I don't like it."