I wasn't there but I imagine it was pretty much what you just described: that you felt like holding hands, it was a surprise to you, you were wondering what it was about... etc. "He was cool with it" says to me that he got at least some sense of where you were coming from.