How do you deal with passive stress?

How do you deal with passive stress? I know that the more you speak the less you stutter. But I noticed that passive stress like lack of sleep, job or university problems causes bigger impact than meeting new people. And I rarely can avoid that stress