I don't think your standards are too high, nor do I think it's unusual to be a little afraid. Your first time is a major life milestone, and you have to have a lot of trust and faith in the other person in order to be remotely comfortable in a situation like that. I don't think your fear is irrational at all.