I think you will feel better if you treat yourself as an adult. 24 is young but still already an adult. Provided you do not seduce minor boys, there is no man you "shouldn't" be talking to. You can choose to have relationships with your age peers and it might be a very fine choice, but it would be a choice rather than your not allowing yourself relationships with older men. Meaning, choosing and not "shoulding" yourself.