That would depend on how much support they have where they are and if they are able to be independent or need care.

I live in a different state from my mother, but she is very active in her community and church and has lived in that town for many years, so she has a good support network and lots of friends.

If she became incapacitated for some reason, then I would probably feel that we needed to be in the same town.

If there is zero economic opportunity where your parents live, and they are doing pretty well on their own, then I don't think that that is reason for moving back where they are. If they are giving you a hard time, tell them to move where you live.