I stutter unless I'm really pissed off at something or using my "dad voice" to make something heard. I have used the "did I stutter?" line myself a few times when I've been completely fluent, it REALLY throws people off their game and makes them feel awkward. Flip it around, don't get upset by it, just own it.