I did catch that...it was the "but I don't want to have to ask..." part I'm suggesting you leave off and instead say "yes, I like receiving flowers because they make me feel _____. I like them for my birthday, valentines day, delivered to me at work. It really shows me that you love me."

This is a very different answer...don't you think? It is a more complete answer and really solidifies that if he does this in your mind you will have been shown he loves you...