I don't think you did anything wrong in regards to starting a new relationship. I don't think it was very cool of you to actively compare this guy to the guy you were seeing though.

Perhaps you could both use this time to define your relationship properly or not. If he withdraws from you without communicating, he needs to make it clear that he wants to have contact with you but withdraws and needs you to be more assertive during those times? You can't read his mind, so he needed to let you know those things.

I think a lot (to my brain anyway) would depend on how long you've been seeing each other on-and-off and how long the breaks have been.