I am not surprised he has issues in a bedroom department, drinking and possibly smoking something else rather than regular cigarettes.

It doesn’t sound like this friendship/relationship is benefiting you. I think you deserve better. Either true friendship without occasional sex mixed in or actual true committed romantic relationship.

Are you seeing a therapist by chance? This could be helpful to sort out your attraction to this guy