Just tell them. More often, they may think that the convo between you has ended or they are breaking some sort of awkward mental thing going on in their head. Just let them know that in the future when having a conversation with you to be a little more patient. I know this feeling all too much.