Do you often stutter around them? Some people don't know how to respond to stuttering, and may find it amusing. Stutterers may themselves find it amusing, depending on context.