No, this is not what all grandads are like. And what matters is not what he means, or not, it how you feel about it. It's completely reasonable of you not to want to put up with it. The last thing you've written speaks volumes.

Did you get anywhere with trying to figure out another option, like a house share?