Yeah, I think about that sometimes too (also six years together), mostly when he's yapping at me and I'm trying to read

Sometimes I feel the same way you do, that being with him is holding me back from what I really want to do -- but the truth is that we are the ones holding ourselves back.
Since you can't change him, maybe you could figure out how to make your travel dreams come true without him. Maybe a girlfriend would go to the beach with you. I've done vacations without my boyfriend. Yeah, I wish he was there, but if he doesn't want to go or can't get time off from work...
If your bf is like mine, he probably has hobbies you don't participate in. There's no reason you can't have your own (like travel).