I don't think they would walk away from you if they are so supportive in other ways. From what you wrote, it sounds like they really care about you but sometimes just say stupid things or don't really understand where you are coming from. That's just my opinion, for what it is worth.