You are definitely not being selfish. It definitely sounds like you could use a break. Maybe once you get some time apart and can gather your thoughts and energy, you can talk to him about this unbalanced relationship that is really taking a toll on you. Personally, if he sees this as you being selfish, he's not the one for you. He's the one completely draining you emotionally and financially and disregarding your needs and feelings.