This guy is way too demanding and pushy, on top of being severely needy. This would have gone south anyways. Consider yourself lucky for learning this now rather than later when you're more deeply involved and having things get worse. Sounds like a huge headache. Too many issues!!! He's also now putting guilt on you. Good riddance. ARGH.