It shouldn't hurt you. Know that whether you stutter or not, you'll get rejected. Now, if you are rejected because of your stutter, see it as natural selection. A woman who is very attracted to you will never reject you because of your stutter. However, if her level of attraction is low and she pulls away, all the better for you; you're buying yourself some time.