I think she is being playful, and has a crazy personality. It depends on how you feel about it personally though. You may need to tell her to stop. Or complain if it really troubles you. I wish all bosses were like that, honestly speaking. Most bosses tend to be very serious, but yours is a joker.