It is not selfish if the care of the pet falls onto you (you didn't sign up for that) and impacts your life or relationship in any way.

Actually, I would say that he is the one who is not thinking it through i.e. how it would impact you personally, your relationship, the care and/or well-being of the pet in question. There is a lot of responsibility attached to owning a pet.