You know, the only way you can get rid of loneliness is to stop blaming it on stuttering. As you may have noticed, there are stutterers in this subreddit and in life in general who have an active social life. Instead of saying, "I don't talk to others because I can't" say, "I don't talk because I don't really want to. I'm comfortable with being alone and in my comfort zone, of course sometimes the loneliness gets to me, but mostly it's tolerable". If you do want to have social interactions with someone, start with casual small talk. Make an effort, learn jokes, be generally educated in the many topics you can chat about. You probably don't have well-developed social skills, work on that. And yes, for the most part no one cares about your stuttering, even in topical English, and people won't judge you, at least not adequately all they're looking for (in your case) is to pass the time quickly.