My best mate also my flat mate has gotten used to my stutter and says he doesn’t even notice it anymore as it seems to be the norm now. If you do want to talk to him about it I’m sure he will listen and understand. Maybe explaining it to him and how it feels when you stutter will make him understand your situation more.