I have caller ID and let the answering machine pick up any number I don't recognize. That leaves me only directly answering people I am comfortable with and therefore doesn't trigger my stutter. Anyway, if you don't want to sound too formal, try coming up with some other casual greeting. "Hey. Talk to me," could work, assuming it doesn't create another trigger. A multi-word greeting like that could even help you establish some speaking momentum.