If you say that and you're a non-stutterer - than yeah, I would be bothered by that. But if you do stutter and say that you're being self-deprecating and making light of it - it's fine imo (within context). I don't stutter as I did when I was a teen - but on the occasion I stutter - I don't highlight it by saying "did I stutter" - I just move on.