Obviously he ruined the relationship by ruining your trust in him, why should you feel guilty for this? If he's capable of forcing himself upon you and over stepping boundaries in the way you described he could probably do worse. Not a definite, but possibly. You need to watch your own back in this situation. Don't feel guilty for his behavior.