I wouldn’t reach out to HR, I’d reach out to him. Explain what you’ve explained here and go from there. There’s no way to tell how he will react but the important thing is that you try and work this out with him directly. HR doesn’t need to get involved unless he wants them too