Yes, men think about sex with every attractive girl, and vice versa. Don't you see an attractive man and it crosses your mind for a split second? That's what attractive means.

I think what you're confused about is why did he tell you?