I always felt more attraction towards people quite a bit older than myself and I myself am more like a modern, fit, lively middle aged person than my fellow 20something year olds.
So I do not think there is a problem as long as both people are into it for honest reasons and truly get along.