What are you getting out of the relationship? Is there something keeping you two together besides your worries that you will lose him and his family if you break up? Have you talked to him about the rut you've noticed?

I would put a password on my phone. Him searching your phone even after you've asked him not to is a huge red flag to me.