I've asked myself the same question many times...I've passed up opportunities due to not being in love with the person, and wanting that as a factor in my first time. At the same time, I do want to experience it...so a bit of a lose-lose situation, as it stands.
I'd tell you what I tell myself: If you want to be in love with the person you have your first time with, then wait. It's better to wait than it is to regret it, I think...you've only got one shot at this particular event, you know? Sure, the wait sucks, but I'm banking on that it'll be worth it.
lol If I beat you to the chase and determine it *isn't* worth it, I will let you know though.