honestly just keep going like that, with patience and understanding, or straight up ask , you might be reading into this too much so at best he doesn't care and if he does then you can have that conversation ! the only person who knows is him in the end