You did the right thing. Should he get lonely (or horny, for lack of a more polite word) and want to spend time with you later, please know in advance that any kindness he shows you will only be manipulation. Without serious professional help, he is never going to change. Don't allow yourself to become lonely enough to miss him. Keep yourself busy, and surround yourself with people who care about you.