Good for you!!! There is nothing wrong about changing your mind. You did not owe him anything, sex should be a gift always given freely, and you have done this person no harm. No harm at all. They're totally fine and can go look for what they want elsewhere. It's okay, and you probably saved both of you a lot of drama, so I think you did very well karma-wise.