I don't think it's his right to pout or act bratty if you aren't in the mood. It takes two, and intimacy (at least as I see it) is something special that shouldn't be forced or "on command." If your libidos aren't compatible and it can't be rectified through communication or a compromise of some sort...well, that is something to consider.
My advice? Keep this matter on the table and open to communication. MAKE him understand what you don't think he's understanding.