I don't know the extent of your anxiety, but my initial gut reaction is you do not have a general anxiety disorder, but you (as like many people who stutter) experience breakdown in speech production (i.e., stuttering) more frequently when you are acutely anxious (e.g., important interview, talking to a person you're attracted to, talking to person you look up to, talking to a person you're intimidated by). Everyone has these. Everyone, fluent or not, gets acutely anxious. How they handle that anxiety varies. You appear to be more physically susceptible to anxiety--your anxiety manifests in your speech. For others it might be loosing eye contact, fidgeting, inability to approach, and others may show few affects from acute anxiety. There are infinite reactions to acute anxiety. There are probably person specific. I thoroughly encourage you to continue observing your speech. I think it's good. I think it can be cathartic. But also keep in mind that humans are very prone to confirmation bias -- we only observe what we expect to observe (For instance, when you were on Valium and weed, were you actually more fluent or was it that you did not notice as many stutters? Either would suggest the drugs helped, but you can't tell the difference after the fact. For that reason I'd only believe an objective measure and not personal report. I have more issues, but they're not important to the purpose of this post). To that end, I have a friend with Tourette's Syndrome who experienced a great deal of benefit from meditation. Given similarities between Tourette's and stuttering with regard to motor control pathways in the brain, it seems reasonable to assume that meditation might work for stuttering. (But as a scientist I want to know did it change the actual movement production or did it change the affective cognitive aspect of communication. Probably all questions for a later date).