The unconscious reads the subtle signs that our conscious mind ignores.
Trust your gut, especially since you have had a bad experience with him in the past.
Good social graces aside, you might feel better if you do not pretend to be ok with him, depends on the group dynamic and on your priorities within it.