I think you would be more secure if you ended your romantic involvement with him. Whatever his reason is for acting the way he does, it doesn't sound like he is trustworthy or that he wants to commit to a relationship with anyone. Is he just stringing all of you along? Good luck with whatever you decide to do.