It's difficult but you have to bristle up to that if it does happen. I too knit up future scenarios so I know what kind of bs to expect. This can turn into a chip on your shoulder and can limit you in some situations. I work on a phone all day and with people in person, even little old ladies who have clearly been bullies all their lives; acting like I'm a side show. They are embarrassing themselves and you will be doing your job. You should try not to walk around like you have anything to be sorry for. If these folks are the only thing in your way it's worth a try. If anyone harasses you document it but try not to react too much right away. If a kind coworker sees it happen you can have them back you up when you go to management. Trouble with that is when managers don't care. There are always lawyers for that but honestly if you don't want this there are many jobs out there. don't stop believing.