I had a similar experience in uni. If I could go back, I would've joined more sports and social groups that interested me to make friends. It might take longer to make friends because you have a stutter and some people might be bothered by that, but it's 100% still worth pursuing social connection despite the potential pitfalls.