I personally get very annoyed by it, unless I'm giving some kind of cue that I need help looking for a word. If it's friends it doesn't bother me as much, but if another person does it that's not a close friend I see it as them lacking the patience and I'll politely make it VERY clear that I won't let that slide.