No, you have a right to be known as whatever you wish and don't have to justify it to anyone.

I hate my real first name and never use it. I plan on changing it legally but my mother has emotionally manipulated and guilt tripped me out of it. Hopefully one day I work up the guts to do it.