Avoidance behavior like this usually doesn't have a positive effect on the mental side of your stuttering.