Hello and welcome to Psych Central.
Hope you can find some support here. Sometimes our intuition tells us when something is not quite right.
I have assumed that you have tried to talk to your hubby about this. If not please do. Is he aware that this is making you feel uncomfortable?
Maybe she is lonely and needs to find a wider range of help not just your husband. Is there a CWA in Tamworth or community groups that could pitch in. Does he need the casual hours that she provides?
I dunno maybe the next time when they have an extended "trip" you could offer to go along to help or go shopping or something.