If it feels right, then visit. Your visit is between you and your ex-MIL and should be of no concern to anyone else. Maybe you can try to plan your visits so that you and your MIL don't have to deal with other family members and really enjoy your time together. Blessings to you for taking the time to visit her and bring her some happiness.