Personally, hearing "I'd be with her if it weren't for you" equals "this relationship is comfortable for me but I'm not really into it."

I had a guy say that to me and I left him. He called me up saying some of my mail had come to his house. Little did I know he was using that as a way to get me to come over and see him and her together. She was in his shirt and boxers, p.s. That kind of attitude (for my perception of how a relationship SHOULD be) is total BS.

However, like Perna said....if there are set reasons/goals for this relationship that are not necessarily based purely on feelings then I don't see how there can be any bad feelings towards him. You need to figure out what YOU want. Sounds like you want love, and he doesn't. Marriage for the sake of marriage isn't a REAL marriage, IMO.