Well the age doesn't really matter, but context is everything.

For instance:

How much older is the guy?
Are you still in school?
What do each of you do for a living?
Is there any drug/crime/abuse etc past with him?
What kind of "baggage" do you both bring to the table?

But really when it comes down to it, you're 19, an adult, and can make your own decisions.