I also struggle with this but more so with making friends. As difficult as it is, you need to embrace your stutter more. Regardless of what people say about it or how they perceive your stutter, accept it for what it is. Your stutter doesn’t define you but it is a part of you. Don’t be with people who don’t like you for you!