Your son is old enough to manage on his own with his father. Your son knows very well that his father has a life apart with his g/f.
Make your own way now. It will not make you less lovable in your son's eyes. He might even be happy for you.
You did good raising your son. It's your turn now.