It reminds me of when someone has a miscarriage and people say oh well it wasnt a real baby ! Same type of thing people saying well at least it wasnt a real affair !
Yes it was as they are both betrayal and can kill a relationship dead.
I wish you well and hope you two can both fight through this ....