Just say there's no need to apologise, it doesn't bother me at all. Stuttering is not an attribute. It's a burden. I don't think very many people would like hearing someone likes something they'd do anything to get rid of.