I'm the same way with drinking and smoking as you described. With the mushrooms, however, my fluency remained for 1-2 weeks afterwards, even though the trip lasted for around 8-11 hours. I think this was the main difference for me—afterwards I was totally sober and totally fluent (first time both coincided lol).