The way many men are brought up they may feel less comfortable with emotional expression. You may unconsciously be picking up on this which in turn makes you feel uncomfortable and like you need to apologise.

If they ask, they may well be interested, so it's ok to tell them. As rachel says, now you have noticed your behaviour, maybe you could rehearse ways to reply and ways to avoid over apologising, plan what to say and practising in front of the mirror can make it easier to say things the way you would prefer to have said them.

I hope the rambling makes sense.

Good luck.