It happened with me as well. When i started learning Japanese, during the first month or so my stutter nearly disappeared while speaking Japanese words and syllables but then returned after i became a lil fluent.