Sounds like he's a tad too attached to his phone, or who's on the other end.
I don't think you are being irrational or out of line at all. It sounds very disruptive, let him know how you feel, he may not realize it bothers you.

chaotic