I think it may be a guy thing. I've never felt intimated by anyone's size, because at 5'2" I'm used to people being taller than I am. For a couple of years I dated a guy who was 6'4" and he once told me that when he was younger he knew his height could intimidate other guys at need. (One of the reasons I broke up with him, BTW!).
I've been watching
Blue Bloods a lot recently and Tom Selleck's two staff assistants are, like him, big tall men. All I've thought about that is that they look like big cuddly uncles who could protect me (or anyone on the show) from any danger.
And when I hug a tall friend my ear is right at his chest level and I can hear his heart beat and that makes me feel loved and secure.