That sounds like a really good idea. I wouldn’t provoke him, especially since he gives you an uneasy feeling. Just have the homeowner give him notice to vacate based upon non-payment/late payments of rent. I hope he doesn’t turn out to be a bigger problem than his is now. Depending upon the state you’re in, getting him out of the house may be difficult. Make sure your i’s are dotted and t’s are crossed.