Just keep inviting him out with you guys, let him open up. Don't say things like 'take your time' once I feel comfortable in a social group my speech improves a lot