You aren't overthinking it, the people closest to you have made mockery of you. That's sad and depressing, but that's life as a stutterer, you never chose this so you don't have to hold on to other people's perception of your worth, if you do, you give them more relevance over you when in reality, it's just shitty people doing shitty things at that point in time. You can remember it, but don't give it the power to affect you.