Maybe it means that he's an immature jerk?

Any guy who puts you down for taking care of yourself isn't worth having around. People without anxiety don't understand just how exhausting anxiety can be.