Your feelings are totally valid.

But to think about it from his perspective, he may have wanted to make sure he didn't trigger or harm you by hugging you. Physical touch can become very difficult in therapy for those who have been sexually abused or raped, and I think it's all of that potential mess he didn't want to stir up. He may also just have a rule about hugging clients.