I am like your guy in terms of forgetting the phone charger and losing material possessions etc. It is not done out of malice - let me assure you of that. Some of these traits can, with time and extreme perseverance, be corrected - I am now quite punctual and I used to be perpetually late everywhere. You are thinking that it is inadequacy on his end - it is, but it is not malicious or intentional. My advice is to never talk to him about it, but, on YOUR end, stop enabling him - if he has lost his wallet, he gets to go through the process of reporting lost credit cards, obtaining a replacement driver's license, and other such steps that are, taken together, the exact opposite of "having a fun time". He does not get to visit you.