That's why eye contact is so awkward with a stutter. The awkwardness can be overcome though. Easier said than done but try not to take the burden of the other person feeling awkward onto you. It is not your fault you have a stutter and they can wait two seconds for you to talk.