Confrontation doesn’t always mean it will end poorly. One of the nurses at my job kept cutting me off (I tend to stutter more over the phone) so I went over to her in person and told her to refrain from doing so. How the coworker feels/responds is their problem and if they have a problem they can speak to your supervisor. We don’t come to work to have jokes made about something we can’t control so set your boundaries asap.