No one stutters in my family and we don’t have any family history of stutterers. I was like your wife and didn’t want to have children because of my speech. I eventually changed my mind and have two awesome sons. My youngest had a stutter for a few months when he was 3 and outgrew it. During this time it let me see that it wasn’t the end of the world, and of all people, I knew how to help him if it was permanent. Ultimately it’s your decision and I wish you all the best.