You are not likely grieving about him as much as the loss of your hopes and future expectations of the relationship. The future you envisioned could be what are really feeling the loss of.