Maybe you just feel guilty that you were attracted to another woman and even though it may have not been physical you entertained it mentally. Talking to your wife about maybe avoiding that situation again, including over drinking, may ease your guilty feelings.

I hope things work out for you and that your grief desists.