Thats rough. I do tend to stutter around certain people more than others as well. In my case, I believe it boils down to confidence and the power dynamic I have with this person. "Are they in a position of power over me?" and "Am I confident to stand up to them if I had to, if they are?"