Congrats!

It's normal to feel guilty. Though you are taking your own journey and found a new job and will have new memories to enjoy.

I don't see anything wrong with visiting your old job every once in while to see how they all are doing and I know they would like it too!