Tasting semen also has overtones of homosexuality, and many straight men are deeply uncomfortable with any activity which is even remotely gay.
(They might even have done that in private, to satisfy their curiosity, but revealing that to another person is entirely different...)
I have also known women who are disgusted by their own scent and appalled at the idea of a man kissing them after he has been eating at the Y.