I'm curious as to why you feel guilty?

As long as you are both unattached adults you are both free to do as you wish.