Believe me, even if you or boyfriend have issues with conceiving that doesn't mean you won't have kids. Both my sister and I had trouble. Her twins just started college and my triplets just started kindergarten. neither one of us did the expensive invitro either. We had help via fertility drugs though.

I would say stop with unprotected sex until you are ready to be a parent though. It's obviously causing anxiety and that can also cause trouble with conceiving.