To be honest it really just depends on how bad your in-fluency is at that moment in my opinion. Today’s society is not patient enough to subdue their mental reactions and replies for very long. They tend to interrupt and interject. That’s just what society has taught us, time is money, hurry up. And some of us mumble like me which worsens peoples understanding. I don’t mean to diminish the language barrier or others stupidity, as I stutter myself, a lot more than usual lately 😡. For all we know he was bad at cardinal directions or has a bad memory and just was confused and moved onto the next person on the street (which I think you’re highlighting). The shitty thing is when it comes to how fluent we are, sometimes people just shut down and stop listening. It depends on their patience. We don’t really know.