You can't control how others feel and also if they attack your speech that's an ad hominem fallacy meaning that they probably don't actually have a rebuttal to your argument