Sounds like he doesn't put in as much effort into the relationship as you do.