If there is nothing holding you back such as marriage I would pack up and leave. This guy sounds like a slacker and very immature I might add. Cut your losses now while you're still young.