I would like to be more compassionate, but personally I would dump this guy.

He thinks you are cheating on him because someone from your past simply contacted you and you didn't tell him? You didn't tell him 100% about your past and he thinks he has full rights to know everything?

Huge lack of respect.