I was in an abusive relationship with my husband, since died, so can understand just how intimidating it can feel in the presence of someone taller, and my late husband was also a shouter. In itself, shouting is another form of intimidation. Because an aggressor is physically bigger, it's natural to expect them to use their height or bodily mass as leverage into getting what they want. Being stared down is another area that feels intimidating.

There are methods of avoiding confrontational people. One is not to let your discomfort show, but to gaze back focussing your eyes on their forehead, between their eyes and if you can, move closer doing so. Being shorter and closer will cause the taller one to back off, a psychological action because taller bigger people find it difficult grappling with someone shorter.

This was an action I did in self-defence, and when my husband did lash out, I paralysed his arm with a sharp chop on his arm's median nerve with the edge of my hand. That immediately stopped husband's further hostility because he realised what I was capable of. Not helping of course is when an opponent has been drinking alcohol.

@Peter86 I recommend you a short course on self-defence. Seek out in your town a martial art called Taekwondo. Effectively, even a beginner can learn to "throw away" an opponent, causing the least possible harm that would be acceptable in a court of law.

Look on Google for Taekwondo classes that are most highly rated (usually out of '5'), and go from there.

Everyone has the right not to be bullied. I wish you all the best.