Yeah I can see it affecting women as well, the problem is that men are largely judge on cofidence when it comes to attraction and even when you confidently stutter everyone sees it as a personal flaw.