Sadly, being alone or whatever avoidance of people will make matters worse. Facing your stutter/stammer now is the only way to overcome it. If you don't like your job, that's one thing, but leaving because of your impediment is another, you cannot escape it, trust me I have tried