I don't blame you for being mad. Let him know how upset you are and what his actions have done to you. Maybe then he will understand. If you continue to stay silent he is more likely to continue doing the things that upset you. Speak up and be heard.