I think you've answered it in your own post - it feels like isolation. I wonder if he thinks it will be tranquil, and thinking you both can enjoy a slower pace. Best thing is to talk, and to see if you can reach a compromise. Perhaps you could retire instead 5-10 years time?

Good luck!