You are not being selfish in wanting more importance in your friend’s (romantic) life. It has gotten so far-gone, I’m not sure what to suggest you do. I think, figuring out what you may be doing that makes people not be your friends and conquering that issue, then making new friends, and filling more of your time with them while still being supportive of your long-time friend for the mere hours you see him is probably a positive way to go for you.