He has no right treating you this way and none of this is your fault.
Have you ever thought of counseling? It could be an option... Im sorry...