I agree with Gayle. We are our own worst critics.
Invite him again. There will most certainly be less awkwardness.

I recently "lost" a very good friend due to lack of contact on my part. Socializing is the last thing I want to do, so I applaud you for going out!

Friendships, just like any relationship, require effort on both parties part.