It is absolutely ok to walk away. She is grown, and it's time to make her own decisions.

She seems to be unnecessarily vindictive, and even if there have been issues since your accident a little understanding wouldn't go a miss.
It's not as though your forgetful because your drinking all the time. Or something of that nature, from what you have said it's outwith your control.

Protecting your mental well being is the most important thing for your recovery.

Have you considered family mediation, it might be worth a shot to have unbiased third party involved.