I have discussed this and similar issues with several religious people ; Christian, Muslim and Buddhist. Until recently (the last 60 years) Christian society took the Jewish approach from the Old Testament and frowned (harshly) on cross dressing. Muslim's still do and have restrictions on what women wear in public. Buddhist are far more liberal and Thailand is a good example of gender tolerance that has been practiced for quite some time. Egyptian culture was well into make-up and scanty clothes a long long time ago also. The question should not be why it affects you but why you worry about it and asked the question in the original post. The answer is simple, socialisation. Its a hang over from our parents living in a more restricted period in time. If we consider women and how our liberation took place in the 1970's -80's about 80% of us now cross dress in clothes adapted to our form from men's designs. We owe Coco Channel a debt of gratitude for her contribution in these fashions. The Rocky Horror Show, really set a trend and groups like ABBA , Queen and Culture Club pushed the boundaries back to where they remained for a while. Unfortunately, conservatism (particularly in the USA) preach guilt rather than tolerance and we still pay the price to this day. "All we are saying is give peace a chance" (or whats wrong with fishnet stockings). Be happy with who you are and take care!