I think you may need to have sex with him, and be more touchy with him. As in hugs and kisses. "Honey hows your day", is seen in films but that works a lot. Relationships are not perfect but they can at least be very good. At least he is honest with you. You simply need to ask him what you can do to improve on it.