I'm sorry this is happening to you! Yes, stress can make seizures worse and more often... perhaps moving away from them would help you in the long run. No one should have to make such a choice, but alas, many ppl do. Take care of yourself, and quit worrying about what they say or think. (I know, easier said than done.) I think that's in your best interest.
Maybe you can sign up (online) with many of the service dog organizations,and get one who will alert you to a seizure, and one who will stay with you and protect you during one!