I'm sorry to say it, but this isn't a relationship. You can do much better, and you deserve better. A relationship should have both partners contributing more or less equally. This guy is neglectful at the very least and just skating by with the tiny sliver you will accept from him. Very one-sided deal here. I'd leave someone like this in a hot minute. More, I would never have given him a chance to begin with. Don't sell yourself so very short or think so little of yourself that you'd settle for something like this. Good luck, and I hope you are able to move on and find someone better, someone who will actually make a decent effort for you.