I would give it less weight. The variability of stuttering is often not tied to whatever we think it is. I can struggle more with my best friend at times than I can with a stranger. So many things can affect your speech outside of the person across the table (sleep, work, unrelated anxieties, etc). I'd say focus on how you feel, don't make the stuttering out to be a bellwether.