I would say the majority of men I have dated have said they preffer it without, but since he is still maintaining an erection and managing to Cum, I suggest it's not 'THAT ' much of an issue.
If it gets to a point where it's making him unable to perform then it's a bit of a diffrent issue, but safety first in all things. Hope you work it out.