Nah, my boss knows I take boxing lessons, and I can always tell clients I had an accident, fell off a ladder or something. He would probably find it funny and poke fun at me, he is like that, always good-natured.
Besides, I'm sure it won't come to pass.