Well it is good you started questioning yourself at last. Try to speed up this process until you see clarity.

And, of course, be glad that you had not moved in with him, because THEN things would have been MUCH, MUCH worse!

Finally, do not think that age correlates with brain power. Reread what you wrote that he should know better - so, no, not true. he might still not know in 10 years