What I would do is just be very straight forward and tell him that he needs to give it up. Also tell him that you are frustrated. Then tell him that a relationship is a compromise not just 1 sided. Thats what I would do in your shoes.