Again, you have to do whats best for you.... do you have more sad times then happy? if so, why put yourself through that. Try talking to him, ask him what he wants, he shouldn't get mad and if he does tell him to think about how he's acting.