At the end of the day it doesn't matter, I got over the fact that I stuttered when I was around 17, 23 now. unfortunately its something I do but I still have a loving gf, good paying job and I'm happy. If people are really that bothered by your stutter then those are the people whose opinions shouldn't matter anyways, they aren't kind. Dont be so hard on yourself, you can continue to get better and in the meantime fuck anyone who genuinely has a problem with it, you don't need them in your life anyways. Just be you, and keep being you and the people who are still with you while you are, are the only peoples opinions that you need to worry about.