Does anybody else hide their stutter to the point that people don't realize you stutter but comment on your avoidance behaviors and stuttering side-effects (low confidence)?

Does anybody else hide their stutter to the point that people don't realize you stutter but comment on your avoidance behaviors and stuttering side-effects (low confidence)? When I tell people I stutter, they are usually surprised. However people tend to notice the side-effects of stuttering such as broken speech (due to avoiding blocks and substituting words) and low confidence. For example, a waitress said "Happy Holidays" to me the other day and I had a block while trying to respond, so she just ended up walking away without me saying anything and I felt like such a dick-head. I wish she would have known that I stutter and wasn't trying to be rude. I am assuming some of you deal with this: any advice?