I realize I didn't actually answer the question, just given personal experience. Whether or not it is harder to approach women is entirely up to you. Confidence is key, and as a stutterer, I understand it might not come easily. Like I said above, I was in excellent shape physically (running 40-50 miles a week on the track and cross country team) so that was a big confidence boost) but even something as simple as a fresh haircut can work wonders for how you think of yourself.