You don't have a strange voice, you have a normal voice. Like you, I have a slightly sweet, non-rude voice, and I've been made comments and teased about it in the past. Many men mask their insecurities by forcing their voices to sound deeper and rougher; it's quite noticeable and sounds awful. People are often envious of those who are themselves, without hang-ups, and a lot of the teasing stems from that.