As men, we're simple creatures. A little physical contact goes a long way. Put your hand on his. Ask him to take a walk. Some of us are incredibly dense as well. You might have to spell it out for him if he isn't picking up obvious signals. Stutterers can have extremely low self esteem. Not all of us, but it's somewhat common.