THanks for the wonderful replies guys!

I "was" feeling guilty about leaving but then read your replies and am not anymore

But i think what i'm feeling guilty about is also that I sent him that text saying i was disappointed. I don't know why I just feel bad. I feel like i burnt a bridge or that he's gonna badmouth me now because i've seen him do it to others. Whomever he doesn't want you to be around, he'll just badmouth them and psychologically pull you away from them..
Everyone always thought of me as sweet and innocent there and now I feel like I'm gonna be hated there but why does that bother me?