Just act as if the conversation is still going, look away if someone calls your name etc. Maintain eye contact as the conversation dictates. If I wasn't stuttering and was talking normally, would you currently be making eye contact? If yes, do it, if not, don't.