Life would be boring if work took up all of one's time. Having interests outside of work enriches your life and it can enhance your work because you are happier and well-rounded.

Putting care and attention into whatever work you do for a living will make your more satisfied. So, while it does matter what you do, what matters more is how you do it.