Personally, I've always been most attracted to older men(and no, it's not daddy issues), even as a teenager I found men in their 40s who look in decent shape a lot more appealing physically than younger men. And btw, I say decent shape because I happen to be a relatively active, sporty person and one of the things I most look in a partner is to be able to have an active(not obsessively so though)lifestyle together. But I actually don't care for six packs and bulging muscles, just a normally athletic looking person.

Anyway, apart from the physical, I find that a man with the right personality(open minded, smart, thoughtful, emotionally aware, with a sense of humor, introspective,etc) is much more attractive as a 40+ year old than he was as a 20-30 year old.

So, a man, let's say, my "type", who obviously looks and has the personality I'm inclined to find attractive at 30 as well as at 40-50-60, is twice as attractive to me once he passes 40. I like maturity.

Just because someone is 50+ or even 60, it doesn't mean they're a decrepit old man/old woman. I happened to mentally mature pretty early due to circumstances and my personality, and I liked the same type of men then that I do now at 30.

So let's not shame anyone as long as they're both consenting adults.

I will say, though, that it is true in some cases a difference of 40 years can an obstacle and it's also true that not everyone is mature enough at 20 to be with someone who is 60. There is also a lot of fetishizing(consciously or not) done by older men ,because of sexism, objectification of women and ageism. So yes, those things are to be taken into consideration but it's not a given that they apply in this or another situation.

So it's fine, a date is no big deal as long as no one is pressuring anyone and as long as both people try to be conscious of potential issues and not use each other or fetishize each other.

Now, if the OP is truly fetishizing young women, then that's a huge problem and I advise against it.