Nobody has the right to tell you " You should or should not ".
You can make your own choices on whatever reasons or situations. You can do what your heart wants or not. It is you and you only who knows how you feel. Nobody else. The choice remains yours.
Love is in the eyes of the beholder.