No you aren't crazy.

But abusers are extremely good at making their victims feel that way.

Don't expect your father to ever admit what he did. In his sick mind he probably only remembers that he "spanked" you a few times when you "deserved" it. I wouldn't spend a lot of time around him if I were you. Especially after his denial.