You say you have a mild stutter and that you can be fluent to an extent. I have the worst type of stutter known to man, severe as can be, gut wrenching type of stutter, and I don’t have problems with women generally, so as tough as it sounds you gotta thug it out. It’s the only way. Force yourself to these situations. Good luck mate