Hello, maroda09! I had to get a therapist to help me set healthy boundaries. It's one thing when the relationship has been good, and you actually want to visit, but another when seeing them make you miserable.
They are definitely too controlling. You should be able to lead your own life.