The best time is whenever you start to stutter. I just say that I stutter sometimes (in my case) and will certainly not apologize for it.