Ok, first of all, get your terminology right. "Shemale" is an offensive term for a (usually pre/non-operative) trans woman (of which I am one), someone who was born male but transitions to female, and identifies solely as female (unless they're genderqueer, meaning they identify somewhere outside of binary gender). What you are referring to is an Intersex person - someone born with features somewhere in between male and female. Someone born intersex may identify as male, female, or as something outside of binary gender.

Now, there's no problem with being attracted to trans women or someone who's intersex - we're people too, who want someone to love (or just f**k), just like anybody else. Fetishizing someone because of it, however, is another story altogether. I can only speak for myself, but I don't like being somebody's fetish. It's objectifying, and being seen as a sex object really sucks. But someone who is attracted to me, regardless of my gender identity (or perhaps even partially because of, keyword here being "partially") feels really good!

Finally, though there is nothing wrong with being gay (I'm bisexual myself), being attracted to a trans woman or someone who's intersex doesn't make you gay. In the case of a trans woman, you're a guy attracted to a girl (regardless of what genitals she has), so that's pretty straightforward. In the case of an intersex person, unless the person you're seeing identifies as male, it still doesn't make you gay.