Very very common. Stuttering is not only a speech problem but there is a strong social component at the core. The presence or possibility of a listener introduces the possibility that you will be evaluated socially. When we are speaking privately, there is no social component, and therefore, we aren't concerned with perception or judgement. This is why you probably also stutter even more when speaking in front of a large group, or when meeting someone new.