Hi bigbear68. How awful for you. I agree with rohag in that taking someone with you can maybe be helpful? No matter your brothers situation, he needs to know that he is hurting you. Is there any way you can let him know some of what happened to you in the past?
If not then maybe you should wait until you feel stronger. You are not going to do either if you any favours by visiting him if he sets you spiralling again.
Good luck