I wrote this question and tried to understand myself.
Actually, this isn't a closure. But, when he didn't personally invite me, it sunk to me that person I'm missing doesn't exist. He isn't the friend I missed.
And also, since somewhere I know he had felt something more for me, I guess he wouldn't want me to meet his wife either. May be unintentionally I would have hurt him by not letting him express himself.
All this is my speculation but that is life. We don't get closure always. Sometimes we just need to leave things where they are. Yes, I do wish that I get to know that he doesn't have any ill feelings for me. But, I wouldn't get to know it, so let them rest.