Yeah, I was always closer to my mum growing up. She helped me out a lot when I was younger and actually still does a lot for me to this day. I still live with her at home too. My dad and I were never very close, he was a very difficult man to get close to and he was always fighting with me because I didn't like to talk about things that were going on in my life, or because I didn't pay enough attention at school etc. So that may well explain the preference to interact with females.
What you say about them being older makes sense to me too, I remember one of my high school teachers actually put in a report card that I preferred speaking with teachers to other kids my own age. I think that stems from adults usually being less judgemental (not all of them though sadly).