I'm kind of going through the exact same thing right now. The guy I think I'm in love with has acknowledged that our conversations are flirty and that he enjoys it, but whenever I try to get together with him, he would say "Sorry, I'm busy." This was SUPER triggering to me and resulted in me sending him a long text basically saying that I didn't have the energy to just be his text buddy, and that if he didn't start treating me like he cared about me, I would cut him out of my life. He responded and explained himself and said that he'd do his best to not trigger my BPD, but he really hasn't kept that promise. Since my friend died, we haven't talked. Apparently he's been on a few dates with some other girl

Anyways, I think you're suspicion is valid. What he did was flaky and immature. I'm sorry, but if you can't loving a sensitive person, you need to communicate that to them.